-- Logs begin at Thu 2022-06-16 15:15:22 UTC, end at Thu 2022-06-16 16:34:13 UTC. -- Jun 16 16:02:54.964378 dv-cinder-837167-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 16:02:54.973856 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 16:02:54.976480 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 16:02:54 2022] *** Jun 16 16:02:54.976480 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 16:02:54.976480 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 16:02:54.976480 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: nodename: dv-cinder-837167-3-iscsi Jun 16 16:02:54.976480 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: machine: x86_64 Jun 16 16:02:54.976480 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: clock source: unix Jun 16 16:02:54.976480 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: pcre jit disabled Jun 16 16:02:54.976480 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: detected number of CPU cores: 4 Jun 16 16:02:54.976480 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: current working directory: / Jun 16 16:02:54.976480 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: detected binary path: /usr/bin/uwsgi-core Jun 16 16:02:54.977060 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: your processes number limit is 47680 Jun 16 16:02:54.977060 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: your memory page size is 4096 bytes Jun 16 16:02:54.977060 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: detected max file descriptor number: 2048 Jun 16 16:02:54.977060 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: lock engine: pthread robust mutexes Jun 16 16:02:54.977060 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: thunder lock: enabled Jun 16 16:02:54.977060 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 16:02:54.977060 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 16:02:55.019894 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: Python main interpreter initialized at 0x563c4f9499c0 Jun 16 16:02:55.019894 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: python threads support enabled Jun 16 16:02:55.019894 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: your server socket listen backlog is limited to 100 connections Jun 16 16:02:55.019894 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: your mercy for graceful operations on workers is 90 seconds Jun 16 16:02:55.020247 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 16:02:55.020335 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: *** Operational MODE: preforking *** Jun 16 16:02:55.020565 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: *** uWSGI is running in multiple interpreter mode *** Jun 16 16:02:55.020565 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: spawned uWSGI master process (pid: 103375) Jun 16 16:02:55.020770 dv-cinder-837167-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 16:02:55.022793 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: spawned uWSGI worker 1 (pid: 103376, cores: 1) Jun 16 16:02:55.022793 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: spawned uWSGI worker 2 (pid: 103377, cores: 1) Jun 16 16:02:55.022793 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 16:02:55.688085 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 16:02:55.701241 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 16:02:56.904034 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:02:56.904034 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: from cryptography.utils import int_from_bytes Jun 16 16:02:56.904645 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:02:56.904645 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: from cryptography.utils import int_from_bytes Jun 16 16:02:56.906606 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:02:56.906606 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: from cryptography.utils import int_from_bytes Jun 16 16:02:56.907061 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:02:56.907061 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: from cryptography.utils import int_from_bytes Jun 16 16:02:59.551854 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 16:02:59.552446 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 16:02:59.552676 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 16:02:59.553043 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 16:02:59.553303 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 16:02:59.553693 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.554062 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.554388 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.554708 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.555039 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.555352 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.555676 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.555997 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.556328 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.556587 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.556902 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.557225 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837167-3-iscsi {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.557544 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.557851 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.558184 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.558506 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.558811 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.559133 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.559442 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.559940 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.560379 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.560689 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.561005 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.561340 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.561656 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.561993 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.562280 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 16:02:59.562661 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.562732 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 16:02:59.562798 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.562938 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.563106 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 16:02:59.563244 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.563472 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 16:02:59.563648 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837167-3-iscsi {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.563845 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 16:02:59.564015 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.564227 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.564316 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.564563 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.564668 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.564906 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.564989 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.565229 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.565316 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.565563 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.565718 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.565879 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.566003 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.566240 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.566383 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.566538 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.566639 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.566867 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.566961 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.567153 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.567254 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.567474 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.567571 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.567802 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.567918 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837167-3-iscsi {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.568303 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.568447 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.568540 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.568620 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.568758 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.569010 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.569191 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.569341 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.569487 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.569652 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.569740 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.569953 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.570056 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.570267 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.570370 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.570591 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.570796 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.570908 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.571112 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.571223 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.571482 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.571595 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.571748 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.571898 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.572067 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.572210 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.572391 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.572548 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.572695 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.572849 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.572978 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.573117 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.573285 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.573419 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.573593 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.573743 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.573877 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.574069 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.574213 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.574362 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837167-3-iscsi {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.574517 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.574704 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.574823 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.575020 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.575140 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.575410 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.575499 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.575761 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.575856 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.576068 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.576165 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.576387 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.576481 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.576760 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.576854 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.577020 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.577117 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.577327 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.577416 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.577666 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.577767 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.578008 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.578131 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.578319 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.578422 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.578639 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.578727 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.578962 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.579050 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.579269 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.579365 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.579578 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.579666 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.579884 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.580000 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.580204 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.580297 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.580539 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.580639 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.580844 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.580933 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.581095 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.581184 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.581396 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.581491 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.581703 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.581827 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.582041 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.582208 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.582350 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.582490 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.582656 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.582763 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.582963 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.583107 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.583266 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.583452 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.583573 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.584394 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.584516 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.584812 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.584915 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.585133 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.585228 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.585442 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.585530 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.585751 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.585852 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.586084 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.586175 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.586394 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.586486 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.586702 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.586875 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.587041 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.587130 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.587361 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.587447 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.587667 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.587762 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.587976 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.588073 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.588287 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.588387 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.588596 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.588746 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.588918 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.589037 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.589228 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.589378 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.589537 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.589726 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.589860 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.590075 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.590194 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.590389 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.590490 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.590714 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.590809 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.591062 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.591150 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.591375 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.591470 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.591688 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.591776 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.591992 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.592078 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.592305 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.592402 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.592625 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.592734 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.592934 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.593046 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.593242 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.593330 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.593549 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.593635 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.593855 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.593985 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.594258 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.594347 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.594568 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.594655 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.594874 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.595015 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.595182 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.595271 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.595483 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.595570 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.595803 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.595890 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.596128 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.596216 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.596438 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.596526 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.596746 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.596889 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.597054 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.597144 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.597375 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.597464 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.597715 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.597812 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.598068 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.598175 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.598404 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.598501 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.598719 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.598815 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.599053 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.599142 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.600064 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.600173 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.600332 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.600562 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.600656 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.600737 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.600950 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.601039 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.601278 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.601383 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.601591 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.601679 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.601901 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.602046 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.602238 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.602338 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.602555 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.602644 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.602875 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.602963 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.603206 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.603296 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.603525 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.603614 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.603845 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.603933 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.604164 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.604252 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.604474 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.604562 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.604788 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.604882 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.605120 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.605215 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.605437 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.605532 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.605744 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.605831 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.606078 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.606182 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.606390 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.606489 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.606703 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.606800 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.607054 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.607142 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.607374 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.607472 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.607688 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.607785 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.607997 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.608087 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.608305 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.608392 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.608627 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.608724 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.608940 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.609106 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.609255 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.609342 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.609563 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.609659 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.609872 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.609981 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:59.610208 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.610307 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.610520 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.610616 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.610831 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.610919 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.611141 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.611228 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.611477 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.611581 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.611791 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.611879 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.612106 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.612201 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.612423 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.612512 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.612738 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.612832 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.613047 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.613135 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.613357 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.613444 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.613666 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.613754 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.614004 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.614113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.614312 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.614400 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.614617 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.614703 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.614929 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.615068 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.615257 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.615530 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.615617 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.615863 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.615957 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.616182 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.616278 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.616516 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.616605 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.616825 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.616928 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.617138 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.617236 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.617450 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.617539 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.617761 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.617858 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.618092 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.618231 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.618406 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.618604 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.618742 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.618926 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.619029 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.619282 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.619379 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.619609 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.619696 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.619912 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.619998 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.620236 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.620370 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.620544 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.620632 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.620851 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.620975 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.621166 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.621336 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.621479 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.621655 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.621790 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.622005 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.622124 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.622440 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.622539 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.622761 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.622862 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.623074 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.623168 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.623385 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.623481 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.623719 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.623808 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.624049 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.624139 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.624356 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.624452 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.624679 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.624768 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.625002 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.625097 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.625317 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.625412 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.625621 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.625716 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.626043 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.626149 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.626258 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.626345 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.626563 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.626651 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.626866 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.626954 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.627174 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.627274 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.627478 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.627633 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.627783 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.627970 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.628086 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.628319 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.628408 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.628666 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.628754 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.628983 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.629076 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.629293 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.629382 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.629595 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.629682 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.629896 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.630046 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.630224 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.630314 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.630566 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.630654 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.630894 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.630991 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.631263 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.631351 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.631576 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.631767 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.631909 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.632091 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.632256 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.632421 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.632578 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.632734 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.632920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.633299 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.633523 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.633612 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.633839 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.633982 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.634193 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.634299 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.634536 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.634632 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.634853 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.634940 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.635165 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.635261 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.635486 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.635575 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.635797 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.635884 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.636121 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.636209 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.636430 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.636516 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.636750 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.636837 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.637058 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.637146 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.637376 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.637516 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.637715 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.637810 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.638069 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.638172 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.638388 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.638476 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.638711 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.638798 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.639022 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.639170 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.639339 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.639509 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.639649 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.639824 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.639958 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.640141 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.640269 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.640471 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.640578 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.640811 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.640900 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.641141 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.641237 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.641477 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.641566 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.641788 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.641876 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.642135 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.642225 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.642452 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.642539 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.642770 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.642858 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.643074 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.643163 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.643390 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.643487 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.643718 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.643870 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.644031 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.644118 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.644345 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.644442 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.644658 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.644752 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.644980 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.645068 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.645289 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.645396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.645602 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.645728 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.645914 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.646106 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.646796 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.647011 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.647144 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.647343 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.647459 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.647700 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.647804 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.648060 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.648157 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.648378 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.648468 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.648684 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.648782 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.649000 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.649087 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.649310 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.649398 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.649618 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.649716 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.649961 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.650056 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.650258 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.650372 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.650693 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.650806 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.650890 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.651043 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.651195 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.651378 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.651517 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.651724 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.651821 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.652073 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.652168 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.652413 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.652511 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.652726 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.652821 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.653037 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.653125 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.653342 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.653438 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.653646 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.653742 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.654016 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.654114 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.654329 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.654479 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.654635 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.654799 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.654953 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.655119 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.655274 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.655460 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.655584 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.655804 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.655894 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.656153 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.656251 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.656477 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.656565 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.656805 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.656893 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.657123 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.657226 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.657436 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.657525 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.657752 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.657860 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.658142 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.658245 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.658462 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.658558 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.658774 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.658864 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.659103 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.659201 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.659418 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.659505 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.659731 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.659819 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.660052 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.660190 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.660354 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.660444 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.660666 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.660903 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.661005 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.661088 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.661401 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.661565 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.661719 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.662023 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.662749 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.662842 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.663092 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.663192 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.663435 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.663524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.663770 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.663867 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.664094 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.664183 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.664410 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.664506 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.664724 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.664813 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.665035 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.665137 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.665350 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.665438 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.665657 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.665753 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.665989 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.666093 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.666303 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.666391 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.666608 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.666697 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.666913 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.667035 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.667217 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.667353 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.667525 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.667703 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.667819 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.668041 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.668138 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.668377 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.668479 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.668701 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.668788 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.669008 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.669097 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.669309 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.669404 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.669622 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.669813 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.669944 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.670182 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.670330 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.670535 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.670639 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.670978 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.671084 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.671167 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.671263 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.671462 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.671567 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.671808 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.671911 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.672117 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.672284 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.672457 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.672548 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.672786 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.672923 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.673141 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.673301 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.673457 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.673592 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.673733 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.673874 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.674093 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.674240 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.674383 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.674524 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.674696 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.674844 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.675001 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.675093 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.675314 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.675402 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.675623 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.675725 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.675930 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.676029 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.676240 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.676376 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.676551 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.676699 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.676861 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.677169 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.677316 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.677496 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.677741 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.677838 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.678092 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.678186 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.678488 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.678590 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.678732 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.678836 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.679039 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.679128 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.679345 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.679433 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.679663 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.679893 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.680035 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.680182 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.680336 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.680465 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.680552 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.680774 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.680873 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.681115 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.681228 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.681432 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.681541 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.681731 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.681828 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.682068 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.682160 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.682386 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.682486 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.682688 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.682821 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.682999 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.683099 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.683306 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.683395 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.683617 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.683714 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.683922 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.684009 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.684227 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.684316 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.684538 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.684628 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.684842 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.684930 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.685144 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.685231 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.685452 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.685541 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.685783 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.685871 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.686125 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.686226 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.686431 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.686542 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.686740 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.686853 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.687045 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.687163 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.687352 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.687514 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.687658 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.687827 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.687968 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.688174 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.688270 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.688509 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.688604 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.688854 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.688949 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.689160 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.689249 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.689464 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.689552 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.689790 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.689960 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.690122 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.690211 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.690427 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.690514 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.690731 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.690831 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.691033 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.691178 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.691354 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.691490 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.691661 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.691800 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.691977 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.692080 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.692290 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.692388 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.692607 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.692719 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.692920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.693034 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.693272 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.693446 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.693588 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.693907 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.694146 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.694248 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.694421 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.694590 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.694766 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.694911 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.695055 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.695245 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.695337 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.695578 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.695676 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.695918 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.696010 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.696234 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.696327 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.696546 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.696658 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.696859 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.697000 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.697166 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.697269 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.697488 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.697577 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.697799 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.697888 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.698130 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.698233 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.698436 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.698525 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.698744 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.698832 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.699054 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.699152 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.699367 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.699458 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.699677 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.699765 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.699987 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.700075 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.700299 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.700388 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.700617 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.700724 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.700924 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.701021 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.701233 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.701375 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.701532 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.701620 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.701836 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.701971 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.702175 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.702277 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.702483 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.702579 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.702810 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.702909 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.703185 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.703319 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.703494 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.703583 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.703805 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.703948 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.704108 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.704219 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.704421 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.704517 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.704721 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.704810 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.705026 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.705170 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.705352 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.705480 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.705629 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.705792 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.705959 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.706124 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.706295 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.706436 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.706610 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.706746 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.706918 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.707065 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.707226 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.707385 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.707531 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.707692 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.707883 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.708111 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.708200 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.708422 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.708545 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.709268 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.709440 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.709706 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.709795 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.710093 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.710259 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.710402 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.710518 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.710715 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.710803 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.711034 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.711168 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.711339 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.711473 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.711646 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.711734 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.711955 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.712045 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.712267 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.712354 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.712574 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.712663 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.712882 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.712971 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.713208 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.713297 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.713523 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.713621 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.713838 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.713978 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.714189 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.714333 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.714516 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.714649 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.714844 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.714959 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.715153 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.715284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.715470 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.715606 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.715783 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.715929 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.716096 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.716235 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.716410 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.716554 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.716721 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.716866 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.717035 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.717192 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.717350 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.717518 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.717665 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.717830 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.718003 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.718169 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.718321 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.718478 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.718632 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.718804 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.718946 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.719127 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.719258 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.719443 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.719567 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.719769 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.719915 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.720295 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.720419 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.720504 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.720640 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.720803 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.720955 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.721128 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.721266 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.721454 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.721593 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.721758 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.721892 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.722085 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.722335 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.722424 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.722651 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.722740 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.722966 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.723064 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.723275 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.723364 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.723583 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.723679 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.723893 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.723995 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.724203 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.724291 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.725064 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.725175 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.725385 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.725482 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.725694 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.726038 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.726140 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.726346 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.726435 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.726668 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.726766 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.726985 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.727074 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.727293 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.727380 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.727615 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.727716 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.727922 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.728011 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.728246 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.728343 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.728552 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.728652 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.728854 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.728942 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.729158 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.729246 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.729462 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.729560 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.729777 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.729872 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.730130 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.730222 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.730455 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.730569 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.730787 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.730878 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.731118 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.731215 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.731432 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.731568 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.731773 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.731872 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.732099 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.732191 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.732418 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.732517 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.732739 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.732828 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.733065 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.733154 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.733371 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.733460 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.733683 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.733770 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.734024 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.734139 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.734335 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.734473 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.734640 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.734784 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.734948 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.735106 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.735244 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.735385 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.735568 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.735713 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.735917 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.736129 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.736267 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.736402 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.736532 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.736656 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.736793 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.736947 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.737084 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.737333 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.737474 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.737635 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.737787 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.737960 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.738101 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.738238 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.738390 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.738587 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.738753 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.738959 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.739097 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.739249 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.739387 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.739525 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.739683 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.739819 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.739996 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.740157 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.740309 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.740646 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.740807 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.741158 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.741305 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.741445 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.741605 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.741756 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.741993 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.742189 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.742359 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.742499 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.742634 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.742792 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.742924 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.743064 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.743200 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.743338 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.743484 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.743739 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.743884 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.744029 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.744161 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.744293 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.744424 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.744573 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.744714 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.744714 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.744972 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.745109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.745261 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.745488 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.745636 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.745786 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.745919 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.746089 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.746245 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.746388 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.746532 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.746674 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.746857 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.746988 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.747132 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.747267 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.747406 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.747564 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.747704 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.747860 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.748003 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.748188 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.748338 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.748522 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.748664 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.748848 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.748998 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.749168 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.749312 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.749488 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.749655 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.749807 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.750013 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.750190 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.750335 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.750471 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.750728 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.750874 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.751030 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.751178 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.751330 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.751476 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.751634 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.751780 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.751921 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.752069 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.752214 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.752356 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.752507 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.752643 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.752788 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.752932 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.753089 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.753248 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.753393 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.753535 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.753694 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.753851 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.754093 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.754255 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.754401 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.754548 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.754718 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.754862 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.755019 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.755171 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.755317 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.755464 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.755921 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.756247 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.756396 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.756550 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.756689 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.756849 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.757003 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.757003 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.757290 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.757290 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.757557 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.757695 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.757830 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.758008 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.758423 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.758577 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.758718 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.758864 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.759004 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.759146 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.759306 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.759445 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.759583 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.759719 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.759869 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.760012 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.760164 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.760300 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.760439 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.760585 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.760731 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.760953 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.761097 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.761243 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.761398 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.761559 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.761695 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.761695 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.761992 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.762133 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.762273 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.762436 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.762582 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.762737 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.762878 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.763021 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.763161 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.763300 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.763440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.763614 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.763753 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.763933 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.764072 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.764252 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.764418 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.764564 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.764701 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.764853 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.764982 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.765188 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.765348 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.765492 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.765623 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.765767 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.765913 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.766105 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.766247 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.766398 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.766542 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.766687 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.766829 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.766987 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.767135 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.767291 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.767428 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.767601 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.767834 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.768009 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.768139 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.768265 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.768454 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.768601 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.768759 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.768917 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.769065 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.769213 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.769390 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.769538 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.769701 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.769845 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.770134 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.770283 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.770429 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.770571 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.770735 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.770880 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.771027 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.771822 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.771983 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.772129 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.772268 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.772392 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.772597 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.772742 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.772891 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.773046 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.773191 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.773336 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.773467 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.773604 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.773724 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.773860 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.774030 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.774184 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.774389 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.774554 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.774722 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.774926 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.775077 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.775223 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.775368 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.775567 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.775730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.775884 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.776028 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.776213 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.776428 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.776636 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.776852 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.777034 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.777219 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.777219 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.777574 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.777761 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.778035 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.778238 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.778421 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.778592 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.778755 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.778916 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.778916 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.779259 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.779430 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.779617 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.779792 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.779966 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.780160 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.780339 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.780531 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.780717 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.780717 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.781188 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.781376 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.781555 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.781746 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.781746 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.782043 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.782186 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.782311 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.782431 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.782553 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.782688 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.782811 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.782941 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.783062 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.783191 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.783328 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.783453 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.783598 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.783713 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.783828 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.783937 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.784045 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.784159 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.784300 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.784421 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.784546 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.784673 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.784801 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.784938 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.785075 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.785195 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.785322 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.785450 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.785576 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.785717 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.785834 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.786014 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.786146 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.786274 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.786403 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.786590 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.788336 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.788469 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.788596 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.788735 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.788882 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.789012 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.789140 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.789259 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.789397 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.789553 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.789718 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.789869 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.790060 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.790221 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.790366 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.790514 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.790650 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.790792 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.790937 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.790937 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.791421 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.791571 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.791786 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.791950 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.792100 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.792229 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.792359 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.792510 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.792669 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.792817 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.792962 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.792962 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.793220 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.793378 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.793523 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.793669 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.793810 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.793810 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.794145 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.794292 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.794445 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.794604 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.794741 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.794885 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.795042 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.795187 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.795329 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.795329 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.795589 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.795737 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.795896 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.796043 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.796176 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.796322 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.796322 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.796597 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.796765 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.796891 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.797089 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.797238 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.797396 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.797558 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.797690 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.797809 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.797969 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.798116 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.798261 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.798421 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.798553 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.798686 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.798836 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.798970 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.799118 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.799118 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.799398 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.799531 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.799676 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.799821 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.799979 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.800125 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.800267 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.800425 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.800570 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.800709 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.800868 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.801015 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.801154 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.801310 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.801456 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.801600 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.801755 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.802040 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.802197 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.802343 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.802885 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.803068 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.803233 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.803387 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.803532 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.803676 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.803822 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.803978 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.804148 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.804279 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.804408 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.804544 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.804686 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.804847 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.804990 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.805150 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.805756 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.805984 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.806174 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.806375 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.806563 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.806747 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.806931 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.807075 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.807206 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.807365 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.807503 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.807661 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.807807 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.808020 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.808185 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.808332 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.808475 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.808672 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.808817 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.808965 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.809190 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.809333 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.809480 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.809622 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.809765 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.809911 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.810136 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.810276 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.810410 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.810549 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.810700 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.810961 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.811105 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.811259 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.811462 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.811617 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.811758 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.811925 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.812071 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.812218 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.812359 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.812496 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.812637 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.812795 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.812939 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.813096 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.813096 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.813351 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.813498 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.813639 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.813799 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.813966 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.814107 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.814264 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.814419 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.814558 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.814701 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.814840 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.814840 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.815104 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.815265 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.815416 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.815557 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.815696 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.815835 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.815993 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.816138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.816284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.816438 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.816592 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.816738 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.816899 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.817044 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.817184 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.817333 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.817475 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 16:02:59.817612 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.817612 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.817612 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.817612 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.817612 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.817612 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.818942 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.818942 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.818942 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.819341 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.819478 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.819767 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.820104 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.820424 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.820753 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.821067 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.821394 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.821712 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.822063 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.822393 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.822713 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.823050 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.823386 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.823703 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.824018 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.824333 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.824645 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.824960 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.825271 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.825602 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.825943 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.826264 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.826592 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.826913 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.827237 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.827556 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.827870 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.828203 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.828516 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.828830 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.829151 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.829466 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.829780 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.830130 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.830452 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.830783 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.831111 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.831427 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.831757 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.832094 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.832448 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.832767 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.833120 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.833452 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.834515 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.834846 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.835266 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:59.835516 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 16:02:59.878353 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO dbcounter [None req-31c22e6f-1736-4824-be51-12421009f012 None None] Registered counter for database nova_api Jun 16 16:02:59.900593 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO dbcounter [None req-d74e5783-692a-49af-92af-330f594fed18 None None] Registered counter for database nova_api Jun 16 16:02:59.900879 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_db.sqlalchemy.engines [None req-31c22e6f-1736-4824-be51-12421009f012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:02:59.908241 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writer thread running {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:02:59.921040 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG oslo_db.sqlalchemy.engines [None req-d74e5783-692a-49af-92af-330f594fed18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103376) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:02:59.928033 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writer thread running {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:02:59.966776 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.context [None req-31c22e6f-1736-4824-be51-12421009f012 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14b80623-283f-4ab1-8a5f-44dd7d2daf23(cell1) {{(pid=103377) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 16:02:59.970929 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-31c22e6f-1736-4824-be51-12421009f012 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:02:59.972508 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-31c22e6f-1736-4824-be51-12421009f012 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:02:59.973308 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-31c22e6f-1736-4824-be51-12421009f012 None None] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:02:59.975393 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-31c22e6f-1736-4824-be51-12421009f012 None None] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:02:59.977418 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO dbcounter [None req-31c22e6f-1736-4824-be51-12421009f012 None None] Registered counter for database nova_cell0 Jun 16 16:02:59.981381 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO dbcounter [None req-31c22e6f-1736-4824-be51-12421009f012 None None] Registered counter for database nova_cell1 Jun 16 16:02:59.987347 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.context [None req-d74e5783-692a-49af-92af-330f594fed18 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14b80623-283f-4ab1-8a5f-44dd7d2daf23(cell1) {{(pid=103376) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 16:02:59.989276 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_db.sqlalchemy.engines [None req-31c22e6f-1736-4824-be51-12421009f012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:02:59.991870 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-d74e5783-692a-49af-92af-330f594fed18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:02:59.993184 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_db.sqlalchemy.engines [None req-31c22e6f-1736-4824-be51-12421009f012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:02:59.993490 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-d74e5783-692a-49af-92af-330f594fed18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:02:59.994404 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-d74e5783-692a-49af-92af-330f594fed18 None None] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:02:59.995085 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writer thread running {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:02:59.996351 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-d74e5783-692a-49af-92af-330f594fed18 None None] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:02:59.998662 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO dbcounter [None req-d74e5783-692a-49af-92af-330f594fed18 None None] Registered counter for database nova_cell0 Jun 16 16:03:00.002622 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO dbcounter [None req-d74e5783-692a-49af-92af-330f594fed18 None None] Registered counter for database nova_cell1 Jun 16 16:03:00.010796 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG oslo_db.sqlalchemy.engines [None req-d74e5783-692a-49af-92af-330f594fed18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103376) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:03:00.015718 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writer thread running {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:03:00.016677 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG oslo_db.sqlalchemy.engines [None req-d74e5783-692a-49af-92af-330f594fed18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103376) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:03:00.140589 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writer thread running {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:03:00.150508 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO dbcounter [None req-31c22e6f-1736-4824-be51-12421009f012 None None] Registered counter for database nova_cell0 Jun 16 16:03:00.159488 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_db.sqlalchemy.engines [None req-31c22e6f-1736-4824-be51-12421009f012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:03:00.163721 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writer thread running {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:03:00.164270 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writer thread running {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:03:00.172971 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO dbcounter [None req-d74e5783-692a-49af-92af-330f594fed18 None None] Registered counter for database nova_cell0 Jun 16 16:03:00.182632 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG oslo_db.sqlalchemy.engines [None req-d74e5783-692a-49af-92af-330f594fed18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103376) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:03:00.187437 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writer thread running {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:03:00.513561 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: WARNING keystonemiddleware.auth_token [None req-31c22e6f-1736-4824-be51-12421009f012 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:03:00.520819 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: WARNING keystonemiddleware.auth_token [None req-31c22e6f-1736-4824-be51-12421009f012 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:03:00.521132 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: WARNING keystonemiddleware.auth_token [None req-d74e5783-692a-49af-92af-330f594fed18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:03:00.528479 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: WARNING keystonemiddleware.auth_token [None req-d74e5783-692a-49af-92af-330f594fed18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:03:00.873288 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: WARNING keystonemiddleware.auth_token [None req-31c22e6f-1736-4824-be51-12421009f012 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:03:00.879293 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: WARNING keystonemiddleware.auth_token [None req-31c22e6f-1736-4824-be51-12421009f012 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:03:00.883482 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: WARNING keystonemiddleware.auth_token [None req-d74e5783-692a-49af-92af-330f594fed18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:03:00.885718 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563c4f9499c0 pid: 103377 (default app) Jun 16 16:03:00.887843 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-31c22e6f-1736-4824-be51-12421009f012 None None] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:03:00.889056 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-31c22e6f-1736-4824-be51-12421009f012 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001762 Jun 16 16:03:00.889410 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: WARNING keystonemiddleware.auth_token [None req-d74e5783-692a-49af-92af-330f594fed18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:03:00.889517 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Thu Jun 16 16:03:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:03:00.894766 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563c4f9499c0 pid: 103376 (default app) Jun 16 16:04:19.400153 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-31c22e6f-1736-4824-be51-12421009f012 None None] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:04:19.401796 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-31c22e6f-1736-4824-be51-12421009f012 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002072 Jun 16 16:04:19.402225 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 16:04:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:04:19.415276 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_api:SELECT=3 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:19.416334 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_cell0:SELECT=3 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:19.417537 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_cell1:SELECT=3 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:19.418477 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_cell0:SELECT=3 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:19.875369 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-63f63169-ba7b-4653-b0b3-db29e8ef6f9a admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:04:19.906710 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-63f63169-ba7b-4653-b0b3-db29e8ef6f9a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.497915 Jun 16 16:04:19.907457 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1291 bytes} [Thu Jun 16 16:04:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:04:22.158194 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-31c22e6f-1736-4824-be51-12421009f012 None None] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:04:22.159440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-31c22e6f-1736-4824-be51-12421009f012 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001912 Jun 16 16:04:22.160104 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 16:04:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:04:22.225990 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-6cee630d-3122-4879-9e97-bbfe45f2db74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "name": "cirros256", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "id": "c1"}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:22.244929 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:04:22.244929 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: warnings.warn(msg) Jun 16 16:04:22.276220 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-6cee630d-3122-4879-9e97-bbfe45f2db74 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107815 Jun 16 16:04:22.276898 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 16:04:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 16:04:22.504712 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-cf0ecc22-1e43-4eb0-a93a-996b6e0a64bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:22.507255 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:04:22.507255 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: warnings.warn(msg) Jun 16 16:04:22.510293 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_api:SELECT=3 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:22.511103 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_cell0:SELECT=3 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:22.512499 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_cell1:SELECT=3 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:22.513203 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:22.576917 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-cf0ecc22-1e43-4eb0-a93a-996b6e0a64bc admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291308 Jun 16 16:04:22.578110 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1335 bytes} [Thu Jun 16 16:04:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:04:24.879710 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-6cee630d-3122-4879-9e97-bbfe45f2db74 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:04:24.880729 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-6cee630d-3122-4879-9e97-bbfe45f2db74 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Jun 16 16:04:24.881141 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 16:04:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:04:25.019355 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-0883c69f-b995-4e61-a993-1ffd7145efd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:25.037180 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:04:25.037180 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: warnings.warn(msg) Jun 16 16:04:25.055807 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-0883c69f-b995-4e61-a993-1ffd7145efd2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.167861 Jun 16 16:04:25.056387 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 16:04:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 16:04:25.068413 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-4d32bbad-3f6b-4b05-8a93-9c40f3747c3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:25.069874 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:04:25.069874 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: warnings.warn(msg) Jun 16 16:04:25.104696 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-4d32bbad-3f6b-4b05-8a93-9c40f3747c3d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040125 Jun 16 16:04:25.105296 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1335 bytes} [Thu Jun 16 16:04:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:04:27.325474 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-0883c69f-b995-4e61-a993-1ffd7145efd2 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:04:27.326538 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-0883c69f-b995-4e61-a993-1ffd7145efd2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jun 16 16:04:27.326940 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 16:04:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:04:27.395861 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-8c630347-b2c6-4fde-8b79-43f8b401711a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G"}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:27.416460 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-8c630347-b2c6-4fde-8b79-43f8b401711a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082550 Jun 16 16:04:27.416927 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 16:04:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 16:04:27.429044 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-a81e457a-100b-4105-be69-3d993a0fcb21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:27.453890 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-a81e457a-100b-4105-be69-3d993a0fcb21 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028514 Jun 16 16:04:27.455150 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1335 bytes} [Thu Jun 16 16:04:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:04:29.714995 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-8c630347-b2c6-4fde-8b79-43f8b401711a admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:04:29.716045 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-8c630347-b2c6-4fde-8b79-43f8b401711a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 16 16:04:29.716461 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 16:04:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:04:29.783504 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-db973baf-4eac-45f8-9921-0a999414b9ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:29.805104 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-db973baf-4eac-45f8-9921-0a999414b9ac admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082434 Jun 16 16:04:29.805663 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 16:04:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:04:29.819073 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-bfd85627-079a-4705-b284-a190ac217305 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:29.844829 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-bfd85627-079a-4705-b284-a190ac217305 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030071 Jun 16 16:04:29.845474 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1335 bytes} [Thu Jun 16 16:04:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:04:32.102225 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-db973baf-4eac-45f8-9921-0a999414b9ac admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:04:32.103287 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-db973baf-4eac-45f8-9921-0a999414b9ac admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jun 16 16:04:32.103715 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 16:04:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:04:32.168774 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-9b5400bc-a91c-42d9-bd44-8c88e7536a65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "disk": 20, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:32.187499 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-9b5400bc-a91c-42d9-bd44-8c88e7536a65 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077737 Jun 16 16:04:32.188527 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 16:04:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 16:04:32.200458 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-3e16c4ca-0b03-442b-98ad-27dce3e53c23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:32.226523 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-3e16c4ca-0b03-442b-98ad-27dce3e53c23 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029753 Jun 16 16:04:32.229962 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1335 bytes} [Thu Jun 16 16:04:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:04:34.479226 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-9b5400bc-a91c-42d9-bd44-8c88e7536a65 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:04:34.480165 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-9b5400bc-a91c-42d9-bd44-8c88e7536a65 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001665 Jun 16 16:04:34.487491 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 16:04:34 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:04:34.547935 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-6f4b0685-acbe-45d1-aa8d-144b4c3db80e admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:04:34.575019 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-6f4b0685-acbe-45d1-aa8d-144b4c3db80e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085446 Jun 16 16:04:34.575581 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1291 bytes} [Thu Jun 16 16:04:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:04:36.821367 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-9b5400bc-a91c-42d9-bd44-8c88e7536a65 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:04:36.822418 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-9b5400bc-a91c-42d9-bd44-8c88e7536a65 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 16 16:04:36.822884 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 16:04:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:04:36.883869 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-d4f3cff6-f4ec-4c53-a4a0-b28c65503ea6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "ram": 512, "disk": 1}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:36.902858 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-d4f3cff6-f4ec-4c53-a4a0-b28c65503ea6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074118 Jun 16 16:04:36.903398 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 16:04:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 16:04:36.915736 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-f4d70663-02aa-4cad-b854-2d3f1f7d8fd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:36.943136 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-f4d70663-02aa-4cad-b854-2d3f1f7d8fd9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031345 Jun 16 16:04:36.943721 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1332 bytes} [Thu Jun 16 16:04:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:04:39.216046 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-d4f3cff6-f4ec-4c53-a4a0-b28c65503ea6 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:04:39.217128 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-d4f3cff6-f4ec-4c53-a4a0-b28c65503ea6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jun 16 16:04:39.217565 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 16:04:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:04:39.296702 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-e8a797ac-34f4-4830-a9a8-1ed91b21e1ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "disk": 20, "name": "m1.small", "vcpus": 1}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:39.320408 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-e8a797ac-34f4-4830-a9a8-1ed91b21e1ab admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.095927 Jun 16 16:04:39.321179 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 16:04:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 16:04:39.334804 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-d708291e-92ad-4c30-99c4-cc685de47184 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:39.364501 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-d708291e-92ad-4c30-99c4-cc685de47184 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034166 Jun 16 16:04:39.365970 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1332 bytes} [Thu Jun 16 16:04:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:04:41.823034 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-e8a797ac-34f4-4830-a9a8-1ed91b21e1ab admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:04:41.824049 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-e8a797ac-34f4-4830-a9a8-1ed91b21e1ab admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 16 16:04:41.824457 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 16:04:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:04:41.891984 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-ecfa0df4-70dc-47e0-bed8-9137ccc91046 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:41.923516 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-ecfa0df4-70dc-47e0-bed8-9137ccc91046 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.092465 Jun 16 16:04:41.924285 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 16:04:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:04:41.937370 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-185c741a-ade1-4e33-9e60-64988fcecd3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:41.963100 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-185c741a-ade1-4e33-9e60-64988fcecd3c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029491 Jun 16 16:04:41.963699 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1332 bytes} [Thu Jun 16 16:04:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:04:44.210718 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-ecfa0df4-70dc-47e0-bed8-9137ccc91046 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:04:44.211806 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-ecfa0df4-70dc-47e0-bed8-9137ccc91046 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001654 Jun 16 16:04:44.212527 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 16:04:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:04:44.286908 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-a3bf47c7-9dd0-4594-9e28-3dc4a8f5a530 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "name": "m1.large"}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:44.307291 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-a3bf47c7-9dd0-4594-9e28-3dc4a8f5a530 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.087658 Jun 16 16:04:44.308166 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 16:04:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:04:44.322991 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-a31ab7de-3a28-4cad-8336-b93fb6544fd5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:44.355839 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-a31ab7de-3a28-4cad-8336-b93fb6544fd5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031694 Jun 16 16:04:44.355839 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1332 bytes} [Thu Jun 16 16:04:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:04:46.615043 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-a3bf47c7-9dd0-4594-9e28-3dc4a8f5a530 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:04:46.616058 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-a3bf47c7-9dd0-4594-9e28-3dc4a8f5a530 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 16 16:04:46.618078 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 16:04:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:04:46.683263 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-1a6ef63b-af43-4b86-94ef-99b1c5cc1314 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:46.705365 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-1a6ef63b-af43-4b86-94ef-99b1c5cc1314 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082748 Jun 16 16:04:46.705945 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 16:04:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:04:46.717987 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-b1d1dd35-44b8-4e72-b33d-dac57559afa5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:04:46.745104 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-b1d1dd35-44b8-4e72-b33d-dac57559afa5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030731 Jun 16 16:04:46.745970 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1332 bytes} [Thu Jun 16 16:04:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:05:12.278779 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-1a6ef63b-af43-4b86-94ef-99b1c5cc1314 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:12.279785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-1a6ef63b-af43-4b86-94ef-99b1c5cc1314 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 16 16:05:12.280180 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 16:05:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:12.292260 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:12.345745 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-a9adf55f-933a-48bc-8339-6bd6cbacbaf5 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:12.365218 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-a9adf55f-933a-48bc-8339-6bd6cbacbaf5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.077444 Jun 16 16:05:12.365803 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1291 bytes} [Thu Jun 16 16:05:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:05:13.451432 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-1a6ef63b-af43-4b86-94ef-99b1c5cc1314 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:13.452444 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-1a6ef63b-af43-4b86-94ef-99b1c5cc1314 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 16 16:05:13.453398 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 16:05:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:13.670332 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-a6359227-10f8-445d-9933-c442768ac63b admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:13.676937 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.wsgi [None req-a6359227-10f8-445d-9933-c442768ac63b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-a6359227-10f8-445d-9933-c442768ac63b admin admin] Request method failure captured: Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Accept: application/json Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Accept-Encoding: gzip, deflate Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Connection: keep-alive Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Content-Length: 0 Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Host: 10.222.0.17 Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Openstack-Api-Version: compute 2.90 Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Openstack-System-Scope: None Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: User-Agent: python-novaclient Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Auth-Token: gAAAAABiq1S56m0NEkElw4gbGZSs0hmJiFVPjMdTULaZDCqiaIpUY1x2cVi3zs_xBLMIKDP7Uxx9DtpEp9bT21kt2t15NXV7fB8pC2QJHUIxcUR6F5R-xFIBOfVGVv_aXNfUq1ZdQtcWge17GcJVUMf4hTGZHWizaKmb78IG6b7gaeslC5P5rzA Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Domain-Id: None Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Domain-Name: None Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Identity-Status: Confirmed Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Is-Admin-Project: True Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Project-Domain-Id: default Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Project-Domain-Name: Default Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Project-Id: 47ead53fd5cc424c8de9383e832d40a2 Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Project-Name: admin Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Role: admin,member,reader Jun 16 16:05:13.680320 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Roles: admin,member,reader Jun 16 16:05:13.682242 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47ead53fd5cc424c8de9383e832d40a2"}]}] Jun 16 16:05:13.682242 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Tenant: admin Jun 16 16:05:13.682242 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Tenant-Id: 47ead53fd5cc424c8de9383e832d40a2 Jun 16 16:05:13.682242 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Tenant-Name: admin Jun 16 16:05:13.682242 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-User: admin Jun 16 16:05:13.682242 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-User-Domain-Id: default Jun 16 16:05:13.682242 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-User-Domain-Name: Default Jun 16 16:05:13.682242 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-User-Id: 9593d0f94eed4e3e83f1323aab2716a7 Jun 16 16:05:13.682242 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-User-Name: admin Jun 16 16:05:13.682242 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: method: > Jun 16 16:05:13.682242 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: exception: Flavor 42 could not be found. Jun 16 16:05:13.682242 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: action_args: {'id': '42'} Jun 16 16:05:13.682242 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:05:13.682242 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:05:13.683286 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 16 16:05:13.685138 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-a6359227-10f8-445d-9933-c442768ac63b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:05:13.687039 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-a6359227-10f8-445d-9933-c442768ac63b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.068918 Jun 16 16:05:13.687039 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Jun 16 16:05:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:05:13.692383 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-b4d5f233-a658-456f-91ea-8a0d48be4c96 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:13.695375 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:13.715090 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-b4d5f233-a658-456f-91ea-8a0d48be4c96 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026779 Jun 16 16:05:13.715657 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jun 16 16:05:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:05:13.726563 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-7921d794-c8f0-4d18-b81f-bdbf25596680 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:13.750811 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-7921d794-c8f0-4d18-b81f-bdbf25596680 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027875 Jun 16 16:05:13.751388 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jun 16 16:05:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:05:13.761608 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-adc8367d-8e09-48fb-8de0-884e3d7f0368 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:13.769165 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.wsgi [None req-adc8367d-8e09-48fb-8de0-884e3d7f0368 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-adc8367d-8e09-48fb-8de0-884e3d7f0368 admin admin] Request method failure captured: Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Accept: application/json Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Accept-Encoding: gzip, deflate Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Connection: keep-alive Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Content-Length: 0 Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Host: 10.222.0.17 Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Openstack-Api-Version: compute 2.90 Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Openstack-System-Scope: None Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: User-Agent: python-novaclient Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Auth-Token: gAAAAABiq1S56m0NEkElw4gbGZSs0hmJiFVPjMdTULaZDCqiaIpUY1x2cVi3zs_xBLMIKDP7Uxx9DtpEp9bT21kt2t15NXV7fB8pC2QJHUIxcUR6F5R-xFIBOfVGVv_aXNfUq1ZdQtcWge17GcJVUMf4hTGZHWizaKmb78IG6b7gaeslC5P5rzA Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Domain-Id: None Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Domain-Name: None Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Identity-Status: Confirmed Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Is-Admin-Project: True Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Project-Domain-Id: default Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Project-Domain-Name: Default Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Project-Id: 47ead53fd5cc424c8de9383e832d40a2 Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Project-Name: admin Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Role: admin,member,reader Jun 16 16:05:13.772524 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Roles: admin,member,reader Jun 16 16:05:13.774113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47ead53fd5cc424c8de9383e832d40a2"}]}] Jun 16 16:05:13.774113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Tenant: admin Jun 16 16:05:13.774113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Tenant-Id: 47ead53fd5cc424c8de9383e832d40a2 Jun 16 16:05:13.774113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Tenant-Name: admin Jun 16 16:05:13.774113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-User: admin Jun 16 16:05:13.774113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-User-Domain-Id: default Jun 16 16:05:13.774113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-User-Domain-Name: Default Jun 16 16:05:13.774113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-User-Id: 9593d0f94eed4e3e83f1323aab2716a7 Jun 16 16:05:13.774113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-User-Name: admin Jun 16 16:05:13.774113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: method: > Jun 16 16:05:13.774113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: exception: Flavor 42 could not be found. Jun 16 16:05:13.774113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: action_args: {'id': '42'} Jun 16 16:05:13.774113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:05:13.774113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:05:13.775113 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 16 16:05:13.776440 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-adc8367d-8e09-48fb-8de0-884e3d7f0368 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103377) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:05:13.777621 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-adc8367d-8e09-48fb-8de0-884e3d7f0368 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016540 Jun 16 16:05:13.777621 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Jun 16 16:05:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:05:14.734718 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-7921d794-c8f0-4d18-b81f-bdbf25596680 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:14.736066 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-7921d794-c8f0-4d18-b81f-bdbf25596680 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001671 Jun 16 16:05:14.736548 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 16:05:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:14.940583 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-55e033fc-0ae6-447e-9bc5-c8a0275e6be4 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:14.947660 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.wsgi [None req-55e033fc-0ae6-447e-9bc5-c8a0275e6be4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-55e033fc-0ae6-447e-9bc5-c8a0275e6be4 admin admin] Request method failure captured: Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Accept: application/json Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Accept-Encoding: gzip, deflate Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Connection: keep-alive Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Content-Length: 0 Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Host: 10.222.0.17 Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Openstack-Api-Version: compute 2.90 Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Openstack-System-Scope: None Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: User-Agent: python-novaclient Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Auth-Token: gAAAAABiq1S6BorRsYfPutwNhZ__xSOzfNg2vPGwXLMiItVivf6gM4VpC0Uxjg16jGvkVYo46Rf6wf3y0OsazqUakoH7G3DpUFopYysMOzqqGnVd7GEwaleHHkapKpaD5ktCw36uc-ZbvyuZKwb4zuDnJQhSVwrjxLLfVeJqfDxqlV0mScgkCZ8 Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Domain-Id: None Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Domain-Name: None Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Identity-Status: Confirmed Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Is-Admin-Project: True Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Project-Domain-Id: default Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Project-Domain-Name: Default Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Project-Id: 47ead53fd5cc424c8de9383e832d40a2 Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Project-Name: admin Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Role: admin,member,reader Jun 16 16:05:14.949211 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Roles: admin,member,reader Jun 16 16:05:14.954284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47ead53fd5cc424c8de9383e832d40a2"}]}] Jun 16 16:05:14.954284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Tenant: admin Jun 16 16:05:14.954284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Tenant-Id: 47ead53fd5cc424c8de9383e832d40a2 Jun 16 16:05:14.954284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Tenant-Name: admin Jun 16 16:05:14.954284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-User: admin Jun 16 16:05:14.954284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-User-Domain-Id: default Jun 16 16:05:14.954284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-User-Domain-Name: Default Jun 16 16:05:14.954284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-User-Id: 9593d0f94eed4e3e83f1323aab2716a7 Jun 16 16:05:14.954284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-User-Name: admin Jun 16 16:05:14.954284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: method: > Jun 16 16:05:14.954284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: exception: Flavor 84 could not be found. Jun 16 16:05:14.954284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: action_args: {'id': '84'} Jun 16 16:05:14.954284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:05:14.954284 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:05:14.956349 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 16 16:05:14.958785 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-55e033fc-0ae6-447e-9bc5-c8a0275e6be4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103377) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:05:14.960797 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-55e033fc-0ae6-447e-9bc5-c8a0275e6be4 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068498 Jun 16 16:05:14.960797 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Jun 16 16:05:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:05:14.964967 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-f038d82f-7843-4a90-9cf1-ad2d6a326768 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:14.991837 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-f038d82f-7843-4a90-9cf1-ad2d6a326768 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032604 Jun 16 16:05:14.992841 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jun 16 16:05:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:05:15.004034 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-1a067c59-b26c-406c-86df-65effe15546b admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:15.019377 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-1a067c59-b26c-406c-86df-65effe15546b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018901 Jun 16 16:05:15.020012 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jun 16 16:05:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:05:15.030120 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-369d88b3-454b-42fc-8a46-56734ad16fa6 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:15.035582 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.wsgi [None req-369d88b3-454b-42fc-8a46-56734ad16fa6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-369d88b3-454b-42fc-8a46-56734ad16fa6 admin admin] Request method failure captured: Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Accept: application/json Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Accept-Encoding: gzip, deflate Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Connection: keep-alive Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Content-Length: 0 Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Host: 10.222.0.17 Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Openstack-Api-Version: compute 2.90 Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Openstack-System-Scope: None Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: User-Agent: python-novaclient Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Auth-Token: gAAAAABiq1S6BorRsYfPutwNhZ__xSOzfNg2vPGwXLMiItVivf6gM4VpC0Uxjg16jGvkVYo46Rf6wf3y0OsazqUakoH7G3DpUFopYysMOzqqGnVd7GEwaleHHkapKpaD5ktCw36uc-ZbvyuZKwb4zuDnJQhSVwrjxLLfVeJqfDxqlV0mScgkCZ8 Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Domain-Id: None Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Domain-Name: None Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Identity-Status: Confirmed Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Is-Admin-Project: True Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Project-Domain-Id: default Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Project-Domain-Name: Default Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Project-Id: 47ead53fd5cc424c8de9383e832d40a2 Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Project-Name: admin Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Role: admin,member,reader Jun 16 16:05:15.037109 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Roles: admin,member,reader Jun 16 16:05:15.038707 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47ead53fd5cc424c8de9383e832d40a2"}]}] Jun 16 16:05:15.038707 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Tenant: admin Jun 16 16:05:15.038707 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Tenant-Id: 47ead53fd5cc424c8de9383e832d40a2 Jun 16 16:05:15.038707 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Tenant-Name: admin Jun 16 16:05:15.038707 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-User: admin Jun 16 16:05:15.038707 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-User-Domain-Id: default Jun 16 16:05:15.038707 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-User-Domain-Name: Default Jun 16 16:05:15.038707 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-User-Id: 9593d0f94eed4e3e83f1323aab2716a7 Jun 16 16:05:15.038707 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-User-Name: admin Jun 16 16:05:15.038707 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: method: > Jun 16 16:05:15.038707 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: exception: Flavor 84 could not be found. Jun 16 16:05:15.038707 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: action_args: {'id': '84'} Jun 16 16:05:15.038707 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:05:15.038707 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:05:15.039613 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 16 16:05:15.041124 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-369d88b3-454b-42fc-8a46-56734ad16fa6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:05:15.042442 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-369d88b3-454b-42fc-8a46-56734ad16fa6 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012408 Jun 16 16:05:15.042442 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Jun 16 16:05:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:05:15.973188 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-1a067c59-b26c-406c-86df-65effe15546b admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:15.974241 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-1a067c59-b26c-406c-86df-65effe15546b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 16 16:05:15.974632 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 16:05:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:16.175396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-591dd500-4430-4a76-8f15-8f8552164c67 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:16.183154 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.wsgi [None req-591dd500-4430-4a76-8f15-8f8552164c67 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-591dd500-4430-4a76-8f15-8f8552164c67 admin admin] Request method failure captured: Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Accept: application/json Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Accept-Encoding: gzip, deflate Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Connection: keep-alive Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Content-Length: 0 Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Host: 10.222.0.17 Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Openstack-Api-Version: compute 2.90 Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Openstack-System-Scope: None Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: User-Agent: python-novaclient Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Auth-Token: gAAAAABiq1S7fCDWntKUTED33mR36h_2daX-dSW6TaIdOxNjsjK7Z0l2Me9FCm-4gb6dRH6c0jRcad_sZFTdyF1KSc4DsU7p-9ww-M0idDow3DSthCn_9Z_tmkX8nqZR01FpAsBY3WIvIyyTp_lCi_f68HDY3RrFNxxqmIxVlMI5d1M5DFfjB8o Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Domain-Id: None Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Domain-Name: None Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Identity-Status: Confirmed Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Is-Admin-Project: True Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Project-Domain-Id: default Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Project-Domain-Name: Default Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Project-Id: 47ead53fd5cc424c8de9383e832d40a2 Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Project-Name: admin Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Role: admin,member,reader Jun 16 16:05:16.184683 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Roles: admin,member,reader Jun 16 16:05:16.186004 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47ead53fd5cc424c8de9383e832d40a2"}]}] Jun 16 16:05:16.186004 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Tenant: admin Jun 16 16:05:16.186004 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Tenant-Id: 47ead53fd5cc424c8de9383e832d40a2 Jun 16 16:05:16.186004 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-Tenant-Name: admin Jun 16 16:05:16.186004 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-User: admin Jun 16 16:05:16.186004 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-User-Domain-Id: default Jun 16 16:05:16.186004 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-User-Domain-Name: Default Jun 16 16:05:16.186004 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-User-Id: 9593d0f94eed4e3e83f1323aab2716a7 Jun 16 16:05:16.186004 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: X-User-Name: admin Jun 16 16:05:16.186004 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: method: > Jun 16 16:05:16.186004 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: exception: Flavor 451 could not be found. Jun 16 16:05:16.186004 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: action_args: {'id': '451'} Jun 16 16:05:16.186004 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:05:16.186004 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:05:16.186920 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 16 16:05:16.188396 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-591dd500-4430-4a76-8f15-8f8552164c67 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:05:16.189772 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-591dd500-4430-4a76-8f15-8f8552164c67 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066071 Jun 16 16:05:16.189772 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jun 16 16:05:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:05:16.197188 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-071e4673-b474-4eef-bb0a-a1533d54f1df admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:16.213063 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-071e4673-b474-4eef-bb0a-a1533d54f1df admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019389 Jun 16 16:05:16.213741 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jun 16 16:05:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:05:16.224006 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-021e0e57-947f-4f15-87ad-95781b047f43 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:16.240074 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-021e0e57-947f-4f15-87ad-95781b047f43 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020136 Jun 16 16:05:16.240716 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jun 16 16:05:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:05:16.250225 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-db62ff27-89a0-4925-a07a-5841042e47c1 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:16.257323 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.wsgi [None req-db62ff27-89a0-4925-a07a-5841042e47c1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-db62ff27-89a0-4925-a07a-5841042e47c1 admin admin] Request method failure captured: Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Accept: application/json Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Accept-Encoding: gzip, deflate Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Connection: keep-alive Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Content-Length: 0 Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Host: 10.222.0.17 Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Openstack-Api-Version: compute 2.90 Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Openstack-System-Scope: None Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: User-Agent: python-novaclient Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Auth-Token: gAAAAABiq1S7fCDWntKUTED33mR36h_2daX-dSW6TaIdOxNjsjK7Z0l2Me9FCm-4gb6dRH6c0jRcad_sZFTdyF1KSc4DsU7p-9ww-M0idDow3DSthCn_9Z_tmkX8nqZR01FpAsBY3WIvIyyTp_lCi_f68HDY3RrFNxxqmIxVlMI5d1M5DFfjB8o Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Domain-Id: None Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Domain-Name: None Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Identity-Status: Confirmed Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Is-Admin-Project: True Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Project-Domain-Id: default Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Project-Domain-Name: Default Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Project-Id: 47ead53fd5cc424c8de9383e832d40a2 Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Project-Name: admin Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Role: admin,member,reader Jun 16 16:05:16.258883 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Roles: admin,member,reader Jun 16 16:05:16.260441 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/47ead53fd5cc424c8de9383e832d40a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47ead53fd5cc424c8de9383e832d40a2"}]}] Jun 16 16:05:16.260441 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Tenant: admin Jun 16 16:05:16.260441 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Tenant-Id: 47ead53fd5cc424c8de9383e832d40a2 Jun 16 16:05:16.260441 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-Tenant-Name: admin Jun 16 16:05:16.260441 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-User: admin Jun 16 16:05:16.260441 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-User-Domain-Id: default Jun 16 16:05:16.260441 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-User-Domain-Name: Default Jun 16 16:05:16.260441 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-User-Id: 9593d0f94eed4e3e83f1323aab2716a7 Jun 16 16:05:16.260441 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: X-User-Name: admin Jun 16 16:05:16.260441 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: method: > Jun 16 16:05:16.260441 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: exception: Flavor 451 could not be found. Jun 16 16:05:16.260441 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: action_args: {'id': '451'} Jun 16 16:05:16.260441 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:05:16.260441 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:05:16.261326 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 16 16:05:16.262730 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-db62ff27-89a0-4925-a07a-5841042e47c1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103377) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:05:16.264274 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-db62ff27-89a0-4925-a07a-5841042e47c1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013919 Jun 16 16:05:16.264274 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jun 16 16:05:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:05:17.151590 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-021e0e57-947f-4f15-87ad-95781b047f43 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:17.152607 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-021e0e57-947f-4f15-87ad-95781b047f43 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 16 16:05:17.153097 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 16:05:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:05:17.351752 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-0c68602a-a1f2-431d-b324-a5584c3bbb5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:17.370478 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-0c68602a-a1f2-431d-b324-a5584c3bbb5e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.074456 Jun 16 16:05:17.370945 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Jun 16 16:05:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:18.274662 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-021e0e57-947f-4f15-87ad-95781b047f43 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:18.275989 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-021e0e57-947f-4f15-87ad-95781b047f43 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001809 Jun 16 16:05:18.276492 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 16:05:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:05:18.469098 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-682ac4ae-4233-4276-bf5d-67b161318730 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:18.488394 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-682ac4ae-4233-4276-bf5d-67b161318730 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071646 Jun 16 16:05:18.488871 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Jun 16 16:05:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:19.413061 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-021e0e57-947f-4f15-87ad-95781b047f43 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:19.414165 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-021e0e57-947f-4f15-87ad-95781b047f43 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001857 Jun 16 16:05:19.414569 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 16:05:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:19.629213 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-1a06c114-226d-4f7a-82f9-2814d8ab165a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:19.650435 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-1a06c114-226d-4f7a-82f9-2814d8ab165a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.076197 Jun 16 16:05:19.650990 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Jun 16 16:05:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:20.562159 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-021e0e57-947f-4f15-87ad-95781b047f43 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:20.563170 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-021e0e57-947f-4f15-87ad-95781b047f43 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 16 16:05:20.563569 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 16:05:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:20.759949 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-3eb3b047-923b-4517-8e71-ddd3a1d2902a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:20.777772 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-3eb3b047-923b-4517-8e71-ddd3a1d2902a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071106 Jun 16 16:05:20.778567 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Jun 16 16:05:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:21.672876 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-021e0e57-947f-4f15-87ad-95781b047f43 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:21.673887 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-021e0e57-947f-4f15-87ad-95781b047f43 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Jun 16 16:05:21.675508 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 16:05:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:21.883507 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-2e1f238d-9f5b-45e8-9af7-b2a6f774aa63 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:21.904207 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-2e1f238d-9f5b-45e8-9af7-b2a6f774aa63 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.077034 Jun 16 16:05:21.904752 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Thu Jun 16 16:05:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:06:10.888581 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-021e0e57-947f-4f15-87ad-95781b047f43 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:10.889517 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-021e0e57-947f-4f15-87ad-95781b047f43 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 16 16:06:10.889919 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 16:06:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:06:10.900979 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:10.950414 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-bd0548e6-71b8-4063-b460-3c79c346d6e4 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:10.970823 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-bd0548e6-71b8-4063-b460-3c79c346d6e4 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073784 Jun 16 16:06:10.971369 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1291 bytes} [Thu Jun 16 16:06:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:06:10.994855 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-eb749970-d198-42bb-b836-09fa1af16f11 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:10.998284 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_api:SELECT=14 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:11.005153 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-eb749970-d198-42bb-b836-09fa1af16f11 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013895 Jun 16 16:06:11.005718 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1282 bytes} [Thu Jun 16 16:06:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:06:11.017973 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-861b50bb-1ad6-4c72-8429-7c8b985470a8 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:11.025807 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-861b50bb-1ad6-4c72-8429-7c8b985470a8 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011602 Jun 16 16:06:11.026371 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1285 bytes} [Thu Jun 16 16:06:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:06:11.038073 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-95983ead-e63a-457e-b45d-5cda86044196 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:11.047046 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-95983ead-e63a-457e-b45d-5cda86044196 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012524 Jun 16 16:06:11.048478 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1285 bytes} [Thu Jun 16 16:06:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:06:11.060825 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-a8c12511-3747-4321-bdd2-d3ac758b4c15 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:11.069707 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-a8c12511-3747-4321-bdd2-d3ac758b4c15 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012451 Jun 16 16:06:11.070277 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1282 bytes} [Thu Jun 16 16:06:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:09:31.714084 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-95983ead-e63a-457e-b45d-5cda86044196 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:09:31.715130 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-95983ead-e63a-457e-b45d-5cda86044196 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 Jun 16 16:09:31.715642 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 16:09:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:09:31.902027 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_api:SELECT=6 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:09:32.107265 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-3e14faa8-a93f-430f-8543-ecae47af9e84 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:09:32.109542 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:09:32.109542 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: warnings.warn(msg) Jun 16 16:09:32.111918 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-3e14faa8-a93f-430f-8543-ecae47af9e84 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:09:32.112732 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-3e14faa8-a93f-430f-8543-ecae47af9e84 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:09:32.114265 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-3e14faa8-a93f-430f-8543-ecae47af9e84 admin admin] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:09:32.115059 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-3e14faa8-a93f-430f-8543-ecae47af9e84 admin admin] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:09:32.180852 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-3e14faa8-a93f-430f-8543-ecae47af9e84 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.280020 Jun 16 16:09:32.181757 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jun 16 16:09:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:09:33.227039 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-95983ead-e63a-457e-b45d-5cda86044196 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:09:33.228486 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-95983ead-e63a-457e-b45d-5cda86044196 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002160 Jun 16 16:09:33.228922 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 16:09:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:09:33.433633 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-bd52a9f4-9ca7-42f8-b2a1-42eb99840d3a admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:09:33.435132 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:09:33.435132 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: warnings.warn(msg) Jun 16 16:09:33.436394 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-bd52a9f4-9ca7-42f8-b2a1-42eb99840d3a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:09:33.436827 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-bd52a9f4-9ca7-42f8-b2a1-42eb99840d3a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:09:33.438191 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-bd52a9f4-9ca7-42f8-b2a1-42eb99840d3a admin admin] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:09:33.438619 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-bd52a9f4-9ca7-42f8-b2a1-42eb99840d3a admin admin] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:09:33.459559 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-bd52a9f4-9ca7-42f8-b2a1-42eb99840d3a admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.087442 Jun 16 16:09:33.460132 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jun 16 16:09:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:09:44.804877 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-95983ead-e63a-457e-b45d-5cda86044196 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:09:44.805899 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-95983ead-e63a-457e-b45d-5cda86044196 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 16 16:09:44.806323 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 16:09:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:09:44.953494 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_cell0:SELECT=4 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:09:44.954365 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_cell1:SELECT=4 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:09:44.955021 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_api:SELECT=8 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:09:45.007545 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-08101772-4123-4afb-9867-e03aff85bb1c admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:09:45.008985 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:09:45.008985 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: warnings.warn(msg) Jun 16 16:09:45.010232 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-08101772-4123-4afb-9867-e03aff85bb1c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:09:45.010684 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-08101772-4123-4afb-9867-e03aff85bb1c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:09:45.011507 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-08101772-4123-4afb-9867-e03aff85bb1c admin admin] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:09:45.011938 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-08101772-4123-4afb-9867-e03aff85bb1c admin admin] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:09:45.040397 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-08101772-4123-4afb-9867-e03aff85bb1c admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.091722 Jun 16 16:09:45.040878 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jun 16 16:09:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:09:45.976463 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-95983ead-e63a-457e-b45d-5cda86044196 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:09:45.977473 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-95983ead-e63a-457e-b45d-5cda86044196 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 16 16:09:45.977875 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 16:09:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:09:46.179945 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-5c641e48-984d-408e-9147-5ed09181a84b admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:09:46.181115 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:09:46.181115 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: warnings.warn(msg) Jun 16 16:09:46.182371 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-5c641e48-984d-408e-9147-5ed09181a84b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:09:46.182815 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-5c641e48-984d-408e-9147-5ed09181a84b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:09:46.183591 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-5c641e48-984d-408e-9147-5ed09181a84b admin admin] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:09:46.184012 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-5c641e48-984d-408e-9147-5ed09181a84b admin admin] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:09:46.207051 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-5c641e48-984d-408e-9147-5ed09181a84b admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084044 Jun 16 16:09:46.207634 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jun 16 16:09:46 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:10:46.421253 dv-cinder-837167-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 16:10:46.422203 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: Thu Jun 16 16:10:46 2022 - graceful shutdown triggered... Jun 16 16:10:46.422824 dv-cinder-837167-3-iscsi devstack@n-api.service[103376]: Gracefully killing worker 1 (pid: 103376)... Jun 16 16:10:46.423205 dv-cinder-837167-3-iscsi devstack@n-api.service[103377]: Gracefully killing worker 2 (pid: 103377)... Jun 16 16:10:47.423398 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: worker 1 buried after 1 seconds Jun 16 16:10:47.423398 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: worker 2 buried after 1 seconds Jun 16 16:10:47.423398 dv-cinder-837167-3-iscsi devstack@n-api.service[103375]: goodbye to uWSGI. Jun 16 16:10:47.425060 dv-cinder-837167-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 16:10:47.425715 dv-cinder-837167-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 16:10:47.428786 dv-cinder-837167-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 16:10:47.438333 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 16:10:47.440697 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 16:10:47 2022] *** Jun 16 16:10:47.440697 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 16:10:47.440697 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 16:10:47.440697 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: nodename: dv-cinder-837167-3-iscsi Jun 16 16:10:47.440697 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: machine: x86_64 Jun 16 16:10:47.440697 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: clock source: unix Jun 16 16:10:47.440697 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: pcre jit disabled Jun 16 16:10:47.440697 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: detected number of CPU cores: 4 Jun 16 16:10:47.440697 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: current working directory: / Jun 16 16:10:47.440697 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: detected binary path: /usr/bin/uwsgi-core Jun 16 16:10:47.440697 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: your processes number limit is 47680 Jun 16 16:10:47.440697 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: your memory page size is 4096 bytes Jun 16 16:10:47.441623 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: detected max file descriptor number: 2048 Jun 16 16:10:47.441623 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: lock engine: pthread robust mutexes Jun 16 16:10:47.441623 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: thunder lock: enabled Jun 16 16:10:47.441623 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 16:10:47.441623 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 16:10:47.489726 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: Python main interpreter initialized at 0x55a06634c9c0 Jun 16 16:10:47.489726 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: python threads support enabled Jun 16 16:10:47.489726 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: your server socket listen backlog is limited to 100 connections Jun 16 16:10:47.489726 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: your mercy for graceful operations on workers is 90 seconds Jun 16 16:10:47.490168 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 16:10:47.490168 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: *** Operational MODE: preforking *** Jun 16 16:10:47.490465 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: *** uWSGI is running in multiple interpreter mode *** Jun 16 16:10:47.490465 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: spawned uWSGI master process (pid: 117732) Jun 16 16:10:47.490699 dv-cinder-837167-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 16:10:47.494255 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: spawned uWSGI worker 1 (pid: 117755, cores: 1) Jun 16 16:10:47.494255 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: spawned uWSGI worker 2 (pid: 117756, cores: 1) Jun 16 16:10:47.494255 dv-cinder-837167-3-iscsi devstack@n-api.service[117732]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 16:10:48.175274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 16:10:48.183287 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 16:10:49.467161 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:10:49.467161 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: from cryptography.utils import int_from_bytes Jun 16 16:10:49.467760 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:10:49.467760 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: from cryptography.utils import int_from_bytes Jun 16 16:10:49.514918 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:10:49.514918 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: from cryptography.utils import int_from_bytes Jun 16 16:10:49.515490 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:10:49.515490 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: from cryptography.utils import int_from_bytes Jun 16 16:10:51.947487 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 16:10:51.948169 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 16:10:51.948254 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 16:10:51.948572 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 16:10:51.948833 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 16:10:51.949232 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.949569 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.949919 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.950253 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.951311 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.951311 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.951311 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.951598 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.951856 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.952125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.952446 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.952774 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837167-3-iscsi {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.953103 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.954205 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.954522 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.954859 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.955214 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.955509 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.955826 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.956347 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.957849 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.957849 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.957849 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.957849 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.958214 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.958427 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.958744 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.959065 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.959385 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.959698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.960118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837167-3-iscsi {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.960442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.960763 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.961084 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.961517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.961835 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.962184 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.962520 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.962848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.963166 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.963517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.963845 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.964195 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.964497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.964808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.965126 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.965443 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.965784 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.966130 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.966432 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.966690 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.967023 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.967342 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.967684 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.967997 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.968254 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.968508 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.969790 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.969790 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.970226 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.970438 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.970756 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.971072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.971382 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.971694 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.972007 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.972322 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.972659 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.972981 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.973309 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.973622 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.973972 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.974402 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.974665 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.974984 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.975335 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.975662 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.975975 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.976298 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.976633 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.976946 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.977266 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.977573 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.977900 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.978265 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.978576 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.978834 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.979141 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.979451 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.979775 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.980088 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.980399 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.980710 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.981019 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.981329 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.981639 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.981980 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.982293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.982604 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.982911 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.983224 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.983535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.983845 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.984185 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.984564 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.984911 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.985365 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.985753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.985989 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.986407 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.986598 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.986895 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.987183 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.987555 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.987865 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.988097 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.988416 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.988720 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.989045 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.989362 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.989648 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.989997 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.990314 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.990625 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.990933 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.991257 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.991554 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.991859 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.992164 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.992473 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.992776 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.993100 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.993430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.993743 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.994080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.994397 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.994722 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:51.995065 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:51.995463 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:51.995746 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:51.996065 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:51.996550 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:51.996721 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:51.997049 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:51.997363 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:51.997706 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:51.998092 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:51.998347 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:51.998685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:51.998995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:51.999306 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:51.999628 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:51.999962 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.000487 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.000755 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.000958 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.001274 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.001698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.001965 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.002651 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.002977 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.003473 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.003755 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.004003 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.004336 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.004676 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.004991 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.005307 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.005626 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.005973 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.006322 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.006718 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.006966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.007288 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.007609 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.007940 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.008539 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.008847 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.009144 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.009466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.009789 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.010219 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.010532 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.010851 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.011176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.011483 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.011841 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.012102 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.012415 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.012730 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.013041 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.013368 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.013700 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.014040 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.014385 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.014698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.015098 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.015336 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.015759 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.016857 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.017085 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.017409 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.017722 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.018087 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.018406 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.018722 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.019096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.019407 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.019718 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.020041 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.020358 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.020675 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.020992 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.021308 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.021639 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.021978 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.022298 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.022642 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.022980 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.023290 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.023619 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.024007 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.024264 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.024573 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.024889 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.025199 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.025507 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.025866 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.026151 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.026460 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.026773 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.027083 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.027378 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.027688 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.028014 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.028327 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.029107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.029250 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.029581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.029899 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.030237 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.030586 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.030928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.031252 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.032304 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.032893 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.032984 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.033313 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.033636 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.033994 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.034301 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.034630 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.034950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.035279 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.035601 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.035926 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.036248 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.036578 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.036894 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.037217 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.037564 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.037904 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.038251 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.038580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.038897 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.039220 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.039538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.039860 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.040175 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.040493 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.040818 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.041136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.041460 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.041776 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.042130 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.042452 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.042778 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.043085 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.043405 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.043737 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.044074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.044389 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.044706 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.045033 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.045351 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.045667 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.046007 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.046319 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.046730 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.046947 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.047422 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.047422 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.048058 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.048469 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.048668 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.048982 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.049291 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.049602 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.049946 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.050278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.050593 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.050923 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.051252 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.051562 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.051871 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.052205 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.052548 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.052833 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.053144 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.053455 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.053805 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.054147 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.054462 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.054784 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.055109 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.055425 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.055746 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.056145 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.056372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.056705 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.057024 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.057728 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.057728 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.058096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.058280 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.058596 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.058925 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.059240 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.059556 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.059876 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.060185 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.060501 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.060863 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.061406 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.061749 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.062100 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.062435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.063045 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.063636 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.063785 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.064038 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.064396 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.064713 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.065032 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.065400 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.065658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.066003 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.066322 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.066650 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.066950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.067269 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.067582 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.067892 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.068206 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.068516 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.068837 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.069151 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.069468 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.069778 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.070137 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.070450 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.070761 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.071067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.071372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.071720 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.072029 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.072388 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.072713 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.073063 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.073372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.073686 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.074052 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.074355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.074662 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.074972 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.075288 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.075605 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.075912 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.076228 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.076622 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.076864 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.077179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.077488 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.077870 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.078147 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.079577 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.079577 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.080002 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.080277 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.080536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.080852 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.081223 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.081475 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.082281 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.082281 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.082566 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.082735 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.083190 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.083356 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.083781 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.083950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.084252 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.084614 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.084891 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.085201 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.085517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.085825 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.086180 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.086496 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.086832 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.087202 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.087465 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.087780 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.088092 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.088400 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.088547 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 16:10:52.089045 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.089189 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 16:10:52.089338 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.089497 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 16:10:52.089658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.089801 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 16:10:52.089985 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.090144 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 16:10:52.090457 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.090457 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.090748 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.090891 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.091040 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.091188 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.091361 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.091620 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.091766 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.091908 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.092069 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.092240 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.092383 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.092531 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.092680 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.092828 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.092989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.093423 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.093580 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.093722 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.093947 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.094794 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.095594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.095780 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.096028 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837167-3-iscsi {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.096186 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.096329 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.096469 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.096619 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.096768 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.097013 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.097162 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.097303 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.097443 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.097592 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.097733 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.097885 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.098062 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.098545 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.098698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.098698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.099036 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.099242 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.099409 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.099500 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.099592 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.099761 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.099856 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.099947 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.100031 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.100121 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.100214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.100305 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.100398 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.100508 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.100602 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.100686 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.100777 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.100861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.100943 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.101024 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.101114 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.101205 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.101298 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837167-3-iscsi {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.101382 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.101464 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.101545 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.101649 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.101747 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.101832 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.101936 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.101936 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.102112 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.102258 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.102448 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.102563 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.102752 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.102896 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.103045 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.103208 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.103303 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.103448 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.103532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.103758 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.103901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.104089 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.104245 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.104407 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.104552 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.104717 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.104853 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.105032 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.105174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.105342 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.105502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.105644 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.105797 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.105975 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.106079 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.106288 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.106426 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.106598 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.106754 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.106847 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.107071 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.107173 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.107384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.107478 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.107701 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.107794 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.108019 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.108117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.108331 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.108438 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.108587 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.108682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.108913 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.109006 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.109245 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.109379 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.109691 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.109841 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.110024 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.110144 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.110333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.110435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.110647 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.110754 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.110953 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.111054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.111270 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.111368 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.111586 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.111685 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.111895 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.111987 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.112204 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.112305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.112510 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.112603 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.112875 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.112969 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.113186 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.113279 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.113512 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.113604 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.114061 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.114175 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.114272 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.114364 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.114569 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.114668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.114936 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.115037 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.115264 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.115355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.115587 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.115685 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.115916 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.116032 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.116242 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.116334 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.116570 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.116660 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.116875 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.116975 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.117193 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.117294 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.117508 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.117600 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.117842 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.118033 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.118193 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.118295 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.118511 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.118613 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.118831 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.118994 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.119160 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.119364 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.120192 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.120294 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.120380 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.120380 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.120518 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.120597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.120676 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.120854 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.121184 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.121499 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.121825 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.122196 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.122405 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.122522 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.122756 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.122850 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.123098 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.123188 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.123417 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.123525 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.123889 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.123971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.124073 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.124164 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.124402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.124499 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.124725 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.124806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.125045 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.125161 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.125432 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.126336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.126455 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.126550 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.126636 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.126636 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.126851 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.127141 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.127235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.127320 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.127409 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.127502 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.127625 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.127726 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.127966 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.128058 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.128278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.128370 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.128609 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.128711 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.128924 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.129026 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.129237 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.129336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.129549 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.129652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.129892 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.130066 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.130317 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.130430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.130557 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.130719 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.130885 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.131027 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.131209 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.131321 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.131544 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.131648 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.131857 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.131960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.132177 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.132292 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.132508 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.132620 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.132828 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.132930 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.133398 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.133505 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.133712 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.133819 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.134059 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.134263 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.134374 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.134592 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.134695 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.134910 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.135028 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.135230 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.135342 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.135545 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.135648 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.135856 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.135958 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.136165 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.136263 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.136477 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.136588 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.136787 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.136937 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.137112 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.137255 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.137422 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.137569 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.137749 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:10:52.137893 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.138189 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.138290 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.138378 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.138470 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.138681 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.138776 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.138992 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.139087 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.139338 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.139442 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.139649 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.139743 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.139988 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.140090 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.140314 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.140418 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.140641 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.141292 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.141635 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.141833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.142375 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.142499 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.142591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.142677 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.142762 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.142855 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.142950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.143084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.143274 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.143414 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.143596 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.143756 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.143919 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.144086 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.144241 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.144412 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.144560 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.144741 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.144875 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.145062 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.145197 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.145390 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.145515 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.145734 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.145842 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.146093 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.146416 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.146538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.146753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.146868 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.147073 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.147175 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.147392 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.147497 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.147710 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.147822 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.148029 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.148129 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.148347 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.148449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.148663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.148769 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.148975 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.149133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.149291 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.149470 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.149609 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.149815 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.150051 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.150149 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.150283 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.150473 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.150614 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.150797 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.150955 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.151119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.151275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.151435 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.151596 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.151755 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.151915 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.152075 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.152233 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.152421 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.152598 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.152742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.152917 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.153065 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.153229 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.153384 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.153546 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.153709 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.153865 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.154053 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.154229 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.154371 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.154547 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.154682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.154863 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.154995 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.155180 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.155307 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.155496 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.155624 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.155813 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.155940 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.156129 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.156367 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.157033 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.157346 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.157443 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.157679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.157787 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.158075 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.158486 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.158486 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.158665 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.158741 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.158896 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.158995 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.159091 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.159297 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.159430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.159614 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.159887 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.159981 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.160207 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.160310 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.160534 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.160643 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.160845 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.160948 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.161178 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.161280 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.161495 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.161594 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.161808 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.161893 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.162165 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.162263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.162482 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.162647 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.162792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.162883 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.163108 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.163209 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.163423 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.163529 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.163730 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.163835 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.164048 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.164141 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.164364 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.164460 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.164677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.164780 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.165003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.165098 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.165316 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.165418 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.165658 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.165870 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.166021 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.166250 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.166366 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.166576 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.166681 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.166904 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.167001 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.167232 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.167337 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.167555 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.167647 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.167869 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.167953 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.168197 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.168292 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.168509 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.168612 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.168821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.168924 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.169141 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.169236 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.169508 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.169678 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.169776 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.169884 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.170224 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.170382 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.170517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.170677 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.170810 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.170993 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.171139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.171310 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.171496 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.171668 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.171801 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.171960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.172307 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.172627 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.172943 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.177996 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.178195 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.178315 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.178424 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.178517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.178517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.178517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.178759 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.178861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.178949 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.179050 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.179139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.179212 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.179315 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.179422 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.179519 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.179613 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.179722 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.179821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.179926 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.180044 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.180133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.180218 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.180304 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.180417 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.180513 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.180599 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.180684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.180775 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.180860 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.180945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.181051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.181146 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.181231 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.181323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.181417 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.181510 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.181608 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.181701 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.181794 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.181879 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.181993 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.182096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.182183 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.182183 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.182334 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.182408 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.182487 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.182583 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.182669 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.182752 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.182836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.182941 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.183037 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.183153 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.183245 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.183339 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.183433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.183518 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.183624 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.183724 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.183894 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.184051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.184208 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.184352 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.184576 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.184899 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.185153 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.185278 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.185485 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.185608 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.185846 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.185995 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.186201 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.186297 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.186523 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.186813 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.186922 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.187145 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.187238 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.187423 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.187516 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.188223 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.188535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.188694 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.189019 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.189210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.189296 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.189458 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.189550 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.189846 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.189995 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.190082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.190156 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.190445 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.190548 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.190757 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.190853 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.191081 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.191186 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.191396 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.191493 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.191709 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.191813 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.192027 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.192121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.192345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.192464 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.192721 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.192827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.193016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.193114 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.193294 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.193391 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.193593 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.193704 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.193911 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.194048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.194349 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.194459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.194535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.194733 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.194981 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.195096 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.195433 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.195584 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.195887 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.196014 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.196216 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.196491 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.196604 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.196869 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.196999 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.197409 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.197591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.199759 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.200762 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.200875 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.200955 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.201037 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.201112 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.201112 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.201242 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.201327 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.201409 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.201497 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.201629 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.201629 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.201629 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.201629 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.201629 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.202045 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.202131 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.202205 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.202287 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.202287 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.202426 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.202499 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.202579 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.202652 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.202732 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.202813 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.202887 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.202959 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.203406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.204069 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.204411 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.204748 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.205079 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.205398 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.205721 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.206090 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.206492 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.206786 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.206911 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.207036 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.207184 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.207356 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.207701 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.207813 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.208026 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.208151 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.208405 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.208512 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.208742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.208847 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.209084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.209190 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.209384 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.209499 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.209715 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.209820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.210112 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.210374 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.210492 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.210720 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.210838 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.211047 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.211150 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.211422 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.211550 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.211752 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.211858 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.212042 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.212145 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.212385 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.212500 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.212717 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.212816 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.213058 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.213165 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.213373 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.213479 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.213692 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.213791 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.214031 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.214132 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.214349 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.214449 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.214667 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.214777 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.214982 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.215089 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.215297 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.215403 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.215610 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.215709 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.215927 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.216026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.216240 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.216339 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.216556 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.216664 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.216867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.216974 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.217179 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.217278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.217501 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.217671 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.217833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.218024 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.218182 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.218378 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.218538 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.218708 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.218908 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.219073 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.219284 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.219442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.219619 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.219791 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.219944 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.220100 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.220258 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.220416 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.220592 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.220745 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.220897 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.221055 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.221213 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.221364 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.221527 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.221686 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.221846 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.222022 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.222176 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.222365 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.222543 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.222703 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.222854 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.223053 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.223219 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.223385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.223544 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.223696 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.223854 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.224015 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.224166 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.224330 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.224488 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.224651 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.224809 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.224961 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.225169 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.225345 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.225504 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.225662 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.225813 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.225985 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.226154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.226316 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.226467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.226625 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.226789 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.226947 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 16:10:52.227185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.227339 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.227639 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.227952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.228270 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.228585 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.229512 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.229512 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.229512 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.230370 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.230370 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.230674 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.230853 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.231050 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.231368 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.231684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.232019 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.232341 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.232654 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.232966 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.233282 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.233594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.234076 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.234280 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.234606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.234918 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.235229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.235734 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.236060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.237320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.237320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.237320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.237768 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.238331 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.238653 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.238999 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.239289 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.239618 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.239938 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.240253 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.240566 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.240878 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.241233 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.241545 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.241911 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.242246 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.242569 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.242894 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.243218 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.243535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.243857 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.244168 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.244492 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.244900 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.245130 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.245446 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.245760 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.246141 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.246463 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.246787 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.247115 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.247445 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.247777 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.248089 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.248410 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.248728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.249139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.249359 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.249674 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.250029 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.250975 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.251393 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.251747 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.252034 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.252494 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.252980 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.253458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.253784 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.254150 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.254470 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.254783 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.255101 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.255414 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.255733 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.256045 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.256490 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.256810 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.257226 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.257561 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.257881 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.258493 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.258819 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.259143 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.259459 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.259889 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.260211 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.260531 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.260851 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.261161 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.261471 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.261789 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.262145 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.262458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.262771 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.263082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.263410 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.263720 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.264044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.264470 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.264789 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.265101 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.265767 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.266511 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.266771 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.267106 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.267441 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.267774 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.268109 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.268469 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.268745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.269075 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.269408 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.269727 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.270081 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.270396 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.270726 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.272746 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.272746 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.272746 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.272746 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.272746 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.272746 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.273203 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.273353 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.273845 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.274187 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.274509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.274825 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.275140 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.275477 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.275790 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.276112 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.276432 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.276748 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.277061 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.277377 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.277704 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.278039 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.278371 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.278694 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.279022 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.279348 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.279657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.279985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.280296 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.280607 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.280918 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.281231 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.281664 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.282063 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.282486 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.282870 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.283212 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.283533 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.283897 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.284237 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.284560 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.284950 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.285286 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.285602 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.285915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.286255 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.286569 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.286962 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.287215 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.287532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.288015 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.288488 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.288969 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.289470 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.289979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.290492 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.290973 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.291450 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.291928 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.292404 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.292630 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO dbcounter [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] Registered counter for database nova_api Jun 16 16:10:52.292935 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.293418 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.293955 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.294492 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.295031 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.296530 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.296530 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.296530 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.297043 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.297525 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.298061 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.298560 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.299057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.299768 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.300271 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.300763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.301259 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.301757 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.302283 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.303146 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.303662 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.304155 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.304644 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.305134 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.305624 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.306146 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.306635 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.307125 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.308385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.309092 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.309496 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.310030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.310497 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.311035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.311574 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.312036 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.313185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.313715 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.314190 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_db.sqlalchemy.engines [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:10:52.314419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.314909 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.315485 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.316054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.317034 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.317188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.317751 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.318400 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.318965 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.319533 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.320167 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.320658 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.321222 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.321365 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writer thread running {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:10:52.321711 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.322087 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.322445 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.322783 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.323112 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.323442 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.323772 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.324354 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.324681 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.325026 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.325361 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.326337 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.326337 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.326646 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.326780 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.327020 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.327335 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.327654 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.327975 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.329340 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.329614 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.329905 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.330279 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.330570 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.330891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.331511 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.331873 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.332201 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.332537 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.332871 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.333198 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.333732 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.334309 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.335216 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.335216 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.335703 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.336036 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.336355 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.336671 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.336992 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.337313 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.337629 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.337974 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.338295 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.338632 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.338947 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.339263 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.339583 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.339902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.340216 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.340583 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.340840 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.341153 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.341476 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.341792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.342135 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.342452 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.342778 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.343087 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.343406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.343765 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.344147 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.344464 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.344779 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.345195 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.345430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.345763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.346134 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.346438 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.346801 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.347128 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.347706 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.348049 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.348377 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.348724 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.349066 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.349382 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.349699 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.350033 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.350394 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.350953 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.351488 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.352003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.352513 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.353054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.353555 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.354096 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.354606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.355088 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.355423 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.355749 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.356074 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.356398 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.356757 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.357117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.357449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.357785 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.358353 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.358740 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.359232 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.359650 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.359978 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.360303 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.360697 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.360998 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.361332 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.361649 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.362120 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.362450 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.362903 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.363406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.363833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.364175 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.364514 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.364843 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.365178 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.365533 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.365879 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.366291 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.366596 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.367005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.367492 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.367984 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.368308 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.368635 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.368969 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.369292 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.369610 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.369967 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.370271 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.370587 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.370966 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.371215 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.371527 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.371841 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.372155 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.372465 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.372775 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.373085 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.373395 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.373704 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.374039 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.374352 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.374669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.374979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.375856 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.376107 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.376449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.376788 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.377111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.377441 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.377761 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.378129 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.378446 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.378777 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.379106 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.379430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.379746 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.380086 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.380401 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.380721 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.381073 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.381354 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.381673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.382013 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.382352 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.382688 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.383254 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.383588 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.383915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.384240 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.384562 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.384880 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.385217 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.385362 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.context [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14b80623-283f-4ab1-8a5f-44dd7d2daf23(cell1) {{(pid=117755) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 16:10:52.385535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.385852 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.386203 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.386525 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.386845 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.387172 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.387493 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.387833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.388166 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.388484 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.388817 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.389150 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.389407 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:10:52.389547 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.389813 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.390192 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.390530 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.390972 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.391785 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:10:52.391978 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.392129 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:10:52.392330 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 16:10:52.392521 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:10:52.394533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:10:52.396544 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO dbcounter [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] Registered counter for database nova_cell0 Jun 16 16:10:52.400641 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO dbcounter [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] Registered counter for database nova_cell1 Jun 16 16:10:52.408360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_db.sqlalchemy.engines [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:10:52.410130 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_db.sqlalchemy.engines [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:10:52.415811 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writer thread running {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:10:52.418541 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writer thread running {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:10:52.457229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO dbcounter [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] Registered counter for database nova_api Jun 16 16:10:52.477269 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_db.sqlalchemy.engines [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:10:52.484050 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writer thread running {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:10:52.544387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.context [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14b80623-283f-4ab1-8a5f-44dd7d2daf23(cell1) {{(pid=117756) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 16:10:52.549303 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:10:52.550926 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:10:52.551766 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:10:52.553740 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:10:52.555833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO dbcounter [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] Registered counter for database nova_cell0 Jun 16 16:10:52.559707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO dbcounter [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] Registered counter for database nova_cell1 Jun 16 16:10:52.568186 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_db.sqlalchemy.engines [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:10:52.570840 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_db.sqlalchemy.engines [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:10:52.576287 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO dbcounter [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] Registered counter for database nova_cell0 Jun 16 16:10:52.577707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writer thread running {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:10:52.583724 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writer thread running {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:10:52.584042 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_db.sqlalchemy.engines [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:10:52.588575 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writer thread running {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:10:52.737756 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO dbcounter [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] Registered counter for database nova_cell0 Jun 16 16:10:52.744715 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_db.sqlalchemy.engines [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:10:52.749474 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writer thread running {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:10:52.949384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: WARNING keystonemiddleware.auth_token [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:10:52.956792 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: WARNING keystonemiddleware.auth_token [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:10:53.090738 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: WARNING keystonemiddleware.auth_token [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:10:53.099123 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: WARNING keystonemiddleware.auth_token [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:10:53.305149 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: WARNING keystonemiddleware.auth_token [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:10:53.311496 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: WARNING keystonemiddleware.auth_token [None req-f3c3604c-d852-401e-8714-941dd2673f5b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:10:53.317458 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a06634c9c0 pid: 117755 (default app) Jun 16 16:10:53.447400 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: WARNING keystonemiddleware.auth_token [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:10:53.454269 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: WARNING keystonemiddleware.auth_token [None req-c497722b-e239-417d-8f3f-ffa32e54a722 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:10:53.459637 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a06634c9c0 pid: 117756 (default app) Jun 16 16:11:35.799323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=3 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:11:35.801517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=3 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:11:35.802539 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=3 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:11:35.804150 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=3 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:11:37.228562 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6ee982e8-ac22-4d3d-8706-5babff1c17e3 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Action: 'create', calling method: .version_select at 0x7f38c164c820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-630419493", "metadata": {"Type": "work"}}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6ee982e8-ac22-4d3d-8706-5babff1c17e3 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Request method failure captured: Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 121 Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1Y3nvyGQ21I5IWdiCKxU7-4AZH58C-UeZ3yQYv1eFIVeoN22xOdDRARCnG2YiJzlPNJZOOqLwZAC6aHHk2r4QW2uO5nnq8bZaFFCW_C5DvHadBM5RF8BIW9vyh_ezxMaK7nuUkz3lNtxQDgcaOxk1SSxQBER4XIX8Cpo3tAZZnijXo Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 6c59d2c3976348ac8b7ded542eb6a4cc Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:11:37.249300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:11:37.251470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c59d2c3976348ac8b7ded542eb6a4cc"}]}] Jun 16 16:11:37.251470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:37.251470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 6c59d2c3976348ac8b7ded542eb6a4cc Jun 16 16:11:37.251470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:37.251470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-VolumesNegativeTest-1813234776-project Jun 16 16:11:37.251470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:11:37.251470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:11:37.251470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: b4741eaedd5545e59b1dbb7e5ed14d86 Jun 16 16:11:37.251470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-VolumesNegativeTest-1813234776-project Jun 16 16:11:37.251470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Jun 16 16:11:37.251470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-630419493", "metadata": {"Type": "work"}}} Jun 16 16:11:37.251470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: Jun 16 16:11:37.251470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-630419493', 'metadata': {'Type': 'work'}}}} Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise error Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:11:37.252459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 16:11:37.254278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 16:11:37.255623 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 16:11:37.255623 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.255623 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6ee982e8-ac22-4d3d-8706-5babff1c17e3 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:11:37.255623 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6ee982e8-ac22-4d3d-8706-5babff1c17e3 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.477161 Jun 16 16:11:37.256904 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1155 bytes} [Thu Jun 16 16:11:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1484 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:11:37.739698 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-da9d9e3c-0500-4969-8fbe-0ee40dac4bea tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Action: 'create', calling method: .version_select at 0x7f38c16920d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1997835117", "metadata": {"Type": "work"}}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-da9d9e3c-0500-4969-8fbe-0ee40dac4bea tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Request method failure captured: Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 120 Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1Y3nvyGQ21I5IWdiCKxU7-4AZH58C-UeZ3yQYv1eFIVeoN22xOdDRARCnG2YiJzlPNJZOOqLwZAC6aHHk2r4QW2uO5nnq8bZaFFCW_C5DvHadBM5RF8BIW9vyh_ezxMaK7nuUkz3lNtxQDgcaOxk1SSxQBER4XIX8Cpo3tAZZnijXo Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 6c59d2c3976348ac8b7ded542eb6a4cc Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:11:37.749839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:11:37.751895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c59d2c3976348ac8b7ded542eb6a4cc"}]}] Jun 16 16:11:37.751895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:37.751895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 6c59d2c3976348ac8b7ded542eb6a4cc Jun 16 16:11:37.751895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:37.751895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-VolumesNegativeTest-1813234776-project Jun 16 16:11:37.751895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:11:37.751895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:11:37.751895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: b4741eaedd5545e59b1dbb7e5ed14d86 Jun 16 16:11:37.751895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-VolumesNegativeTest-1813234776-project Jun 16 16:11:37.751895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Jun 16 16:11:37.751895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1997835117", "metadata": {"Type": "work"}}} Jun 16 16:11:37.751895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: Jun 16 16:11:37.751895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1997835117', 'metadata': {'Type': 'work'}}}} Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise error Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi '0' Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:11:37.752837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 16:11:37.754407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 16:11:37.755759 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 16:11:37.755759 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.755759 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-da9d9e3c-0500-4969-8fbe-0ee40dac4bea tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:11:37.757347 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-da9d9e3c-0500-4969-8fbe-0ee40dac4bea tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.495809 Jun 16 16:11:37.762425 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 1/2] 10.222.0.17 () {60 vars in 1155 bytes} [Thu Jun 16 16:11:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 504 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:11:37.773413 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-71994591-0cdb-43f1-8644-4ada76ba50c1 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Action: 'create', calling method: .version_select at 0x7f38c165daf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1631349027", "metadata": {"Type": "work"}}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-71994591-0cdb-43f1-8644-4ada76ba50c1 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Request method failure captured: Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 119 Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1Y3nvyGQ21I5IWdiCKxU7-4AZH58C-UeZ3yQYv1eFIVeoN22xOdDRARCnG2YiJzlPNJZOOqLwZAC6aHHk2r4QW2uO5nnq8bZaFFCW_C5DvHadBM5RF8BIW9vyh_ezxMaK7nuUkz3lNtxQDgcaOxk1SSxQBER4XIX8Cpo3tAZZnijXo Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 6c59d2c3976348ac8b7ded542eb6a4cc Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:11:37.784658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:11:37.786246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c59d2c3976348ac8b7ded542eb6a4cc"}]}] Jun 16 16:11:37.786246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:37.786246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 6c59d2c3976348ac8b7ded542eb6a4cc Jun 16 16:11:37.786246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:37.786246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-VolumesNegativeTest-1813234776-project Jun 16 16:11:37.786246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:11:37.786246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:11:37.786246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: b4741eaedd5545e59b1dbb7e5ed14d86 Jun 16 16:11:37.786246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-VolumesNegativeTest-1813234776-project Jun 16 16:11:37.786246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Jun 16 16:11:37.786246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1631349027", "metadata": {"Type": "work"}}} Jun 16 16:11:37.786246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: Jun 16 16:11:37.786246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1631349027', 'metadata': {'Type': 'work'}}}} Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise error Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi '' Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:11:37.787074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 16:11:37.788497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 16:11:37.789662 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 16:11:37.789662 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:37.799101 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-71994591-0cdb-43f1-8644-4ada76ba50c1 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:11:37.799971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-71994591-0cdb-43f1-8644-4ada76ba50c1 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.031283 Jun 16 16:11:37.800540 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1155 bytes} [Thu Jun 16 16:11:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:11:37.812343 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7a9ce127-f82a-46d4-950c-fa43173e7a85 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Calling method '.version_select at 0x7f38c15b2430>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:11:37.894238 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=3 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:11:37.895667 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=3 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:11:37.899858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=3 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:11:37.901403 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=3 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:11:38.996375 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-7a9ce127-f82a-46d4-950c-fa43173e7a85 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] HTTP exception thrown: Volume tempest-invalid-728645367 could not be found. Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7a9ce127-f82a-46d4-950c-fa43173e7a85 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Request method failure captured: Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-728645367 HTTP/1.1 Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1Y3nvyGQ21I5IWdiCKxU7-4AZH58C-UeZ3yQYv1eFIVeoN22xOdDRARCnG2YiJzlPNJZOOqLwZAC6aHHk2r4QW2uO5nnq8bZaFFCW_C5DvHadBM5RF8BIW9vyh_ezxMaK7nuUkz3lNtxQDgcaOxk1SSxQBER4XIX8Cpo3tAZZnijXo Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 6c59d2c3976348ac8b7ded542eb6a4cc Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:11:39.007591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:11:39.009728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c59d2c3976348ac8b7ded542eb6a4cc"}]}] Jun 16 16:11:39.009728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:39.009728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 6c59d2c3976348ac8b7ded542eb6a4cc Jun 16 16:11:39.009728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:39.009728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-VolumesNegativeTest-1813234776-project Jun 16 16:11:39.009728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:11:39.009728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:11:39.009728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: b4741eaedd5545e59b1dbb7e5ed14d86 Jun 16 16:11:39.009728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-VolumesNegativeTest-1813234776-project Jun 16 16:11:39.009728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: Jun 16 16:11:39.009728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Volume tempest-invalid-728645367 could not be found. Jun 16 16:11:39.009728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': 'tempest-invalid-728645367'} Jun 16 16:11:39.009728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-728645367 could not be found. (HTTP 404) (Request-ID: req-01a5408a-eae8-44d8-8311-2e184068aed7) Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:11:39.010707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:11:39.015902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-728645367 could not be found. Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:11:39.017634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-728645367 could not be found. Jun 16 16:11:39.019051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.019051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:11:39.019051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.019051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:39.019051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:11:39.019051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:11:39.019051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:11:39.019051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:11:39.019051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-728645367 could not be found. Jun 16 16:11:39.019051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.022211 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7a9ce127-f82a-46d4-950c-fa43173e7a85 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Returning 404 to user: Volume tempest-invalid-728645367 could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:11:39.024946 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7a9ce127-f82a-46d4-950c-fa43173e7a85 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-728645367" status: 404 len: 98 microversion: 2.1 time: 1.218793 Jun 16 16:11:39.032173 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1214 bytes} [Thu Jun 16 16:11:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-728645367 => generated 98 bytes in 1226 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 16:11:39.042799 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a9695957-1c90-46d7-95d3-f42b3fcb7a7a tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005372 Jun 16 16:11:39.045217 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 3/5] 10.222.0.17 () {58 vars in 1139 bytes} [Thu Jun 16 16:11:39 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 16:11:39.062239 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f8d350bf-7899-4620-9e33-0893f71e6737 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004921 Jun 16 16:11:39.063660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 3/6] 10.222.0.17 () {58 vars in 1136 bytes} [Thu Jun 16 16:11:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 16:11:39.077773 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-49c21957-9349-4749-bb7c-5b0de8510708 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Calling method '.version_select at 0x7f38c164c790>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:11:39.879895 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-49c21957-9349-4749-bb7c-5b0de8510708 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] HTTP exception thrown: Volume 4ce1a264-69b0-401b-ab1d-2ce52be4be46 could not be found. Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-49c21957-9349-4749-bb7c-5b0de8510708 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Request method failure captured: Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: DELETE /compute/v2.1/os-volumes/4ce1a264-69b0-401b-ab1d-2ce52be4be46 HTTP/1.1 Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1Y3nvyGQ21I5IWdiCKxU7-4AZH58C-UeZ3yQYv1eFIVeoN22xOdDRARCnG2YiJzlPNJZOOqLwZAC6aHHk2r4QW2uO5nnq8bZaFFCW_C5DvHadBM5RF8BIW9vyh_ezxMaK7nuUkz3lNtxQDgcaOxk1SSxQBER4XIX8Cpo3tAZZnijXo Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 6c59d2c3976348ac8b7ded542eb6a4cc Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:11:39.884430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:11:39.886064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c59d2c3976348ac8b7ded542eb6a4cc"}]}] Jun 16 16:11:39.886064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:39.886064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 6c59d2c3976348ac8b7ded542eb6a4cc Jun 16 16:11:39.886064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:39.886064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-VolumesNegativeTest-1813234776-project Jun 16 16:11:39.886064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:11:39.886064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:11:39.886064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: b4741eaedd5545e59b1dbb7e5ed14d86 Jun 16 16:11:39.886064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-VolumesNegativeTest-1813234776-project Jun 16 16:11:39.886064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: Jun 16 16:11:39.886064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Volume 4ce1a264-69b0-401b-ab1d-2ce52be4be46 could not be found. Jun 16 16:11:39.886064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': '4ce1a264-69b0-401b-ab1d-2ce52be4be46'} Jun 16 16:11:39.886064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ce1a264-69b0-401b-ab1d-2ce52be4be46 could not be found. (HTTP 404) (Request-ID: req-2c739b35-5580-497e-8fa3-1f5075443e2a) Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:11:39.886956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:11:39.888068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ce1a264-69b0-401b-ab1d-2ce52be4be46 could not be found. Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 16:11:39.889679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:11:39.893851 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4ce1a264-69b0-401b-ab1d-2ce52be4be46 could not be found. Jun 16 16:11:39.893851 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.893851 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:11:39.893851 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.893851 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:39.893851 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:11:39.893851 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:11:39.893851 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:11:39.893851 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:11:39.893851 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ce1a264-69b0-401b-ab1d-2ce52be4be46 could not be found. Jun 16 16:11:39.893851 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.898221 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-49c21957-9349-4749-bb7c-5b0de8510708 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Returning 404 to user: Volume 4ce1a264-69b0-401b-ab1d-2ce52be4be46 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:11:39.899503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-49c21957-9349-4749-bb7c-5b0de8510708 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/4ce1a264-69b0-401b-ab1d-2ce52be4be46" status: 404 len: 109 microversion: 2.1 time: 0.828268 Jun 16 16:11:39.908670 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 16:11:39 2022] DELETE /compute/v2.1/os-volumes/4ce1a264-69b0-401b-ab1d-2ce52be4be46 => generated 109 bytes in 838 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:11:39.914811 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-93e16327-be53-46cd-912f-ce1c5100f051 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Calling method '.version_select at 0x7f38c14fbf70>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:11:39.972181 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-93e16327-be53-46cd-912f-ce1c5100f051 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] HTTP exception thrown: Volume 2b00dfd2-2cf3-41ba-8aea-57e8c128bfec could not be found. Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-93e16327-be53-46cd-912f-ce1c5100f051 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Request method failure captured: Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/os-volumes/2b00dfd2-2cf3-41ba-8aea-57e8c128bfec HTTP/1.1 Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1Y3nvyGQ21I5IWdiCKxU7-4AZH58C-UeZ3yQYv1eFIVeoN22xOdDRARCnG2YiJzlPNJZOOqLwZAC6aHHk2r4QW2uO5nnq8bZaFFCW_C5DvHadBM5RF8BIW9vyh_ezxMaK7nuUkz3lNtxQDgcaOxk1SSxQBER4XIX8Cpo3tAZZnijXo Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 6c59d2c3976348ac8b7ded542eb6a4cc Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:11:39.975413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:11:39.976763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c59d2c3976348ac8b7ded542eb6a4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c59d2c3976348ac8b7ded542eb6a4cc"}]}] Jun 16 16:11:39.976763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:39.976763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 6c59d2c3976348ac8b7ded542eb6a4cc Jun 16 16:11:39.976763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-VolumesNegativeTest-1813234776 Jun 16 16:11:39.976763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-VolumesNegativeTest-1813234776-project Jun 16 16:11:39.976763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:11:39.976763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:11:39.976763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: b4741eaedd5545e59b1dbb7e5ed14d86 Jun 16 16:11:39.976763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-VolumesNegativeTest-1813234776-project Jun 16 16:11:39.976763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: Jun 16 16:11:39.976763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Volume 2b00dfd2-2cf3-41ba-8aea-57e8c128bfec could not be found. Jun 16 16:11:39.976763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': '2b00dfd2-2cf3-41ba-8aea-57e8c128bfec'} Jun 16 16:11:39.976763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b00dfd2-2cf3-41ba-8aea-57e8c128bfec could not be found. (HTTP 404) (Request-ID: req-fea298af-ca73-47fd-bda0-e5d1505041da) Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:11:39.977672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:11:39.978901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b00dfd2-2cf3-41ba-8aea-57e8c128bfec could not be found. Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 16:11:39.980121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:11:39.981293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b00dfd2-2cf3-41ba-8aea-57e8c128bfec could not be found. Jun 16 16:11:39.981293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.981293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:11:39.981293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.981293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:11:39.981293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:11:39.981293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:11:39.981293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:11:39.981293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:11:39.981293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b00dfd2-2cf3-41ba-8aea-57e8c128bfec could not be found. Jun 16 16:11:39.981293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:11:39.985515 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-93e16327-be53-46cd-912f-ce1c5100f051 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] Returning 404 to user: Volume 2b00dfd2-2cf3-41ba-8aea-57e8c128bfec could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:11:39.986776 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-93e16327-be53-46cd-912f-ce1c5100f051 tempest-VolumesNegativeTest-1813234776 tempest-VolumesNegativeTest-1813234776-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2b00dfd2-2cf3-41ba-8aea-57e8c128bfec" status: 404 len: 109 microversion: 2.1 time: 0.076996 Jun 16 16:11:39.987872 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:11:39 2022] GET /compute/v2.1/os-volumes/2b00dfd2-2cf3-41ba-8aea-57e8c128bfec => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:11:54.410148 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-76265995", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:11:54.634198 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] validate_networks() for [('84d0c54c-ef5a-4a19-a82f-2cbc7460411e', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:11:58.223955 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:11:58.224755 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:11:58.225709 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:11:58.227578 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:11:58.228834 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:11:58.318608 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:11:58.319887 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:11:58.324253 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:11:58.325398 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:11:58.467229 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Getting quotas for project 6eee49063a5847dba6ffb520d0149d88. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:11:58.477115 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Getting quotas for user 515114f0a842463fb2d1265ee33db8eb and project 6eee49063a5847dba6ffb520d0149d88. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:11:58.511158 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:11:58.514333 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:11:58.661416 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-53c551da-3dc4-4492-a59e-86dec07ad959 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.672942 Jun 16 16:11:58.662957 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 5/9] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:11:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 4677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:11:58.679216 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-18b0c97b-8129-48ad-b46f-595ed735df9c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:11:58.680070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-18b0c97b-8129-48ad-b46f-595ed735df9c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:11:59.289820 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-18b0c97b-8129-48ad-b46f-595ed735df9c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:11:59.349067 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-18b0c97b-8129-48ad-b46f-595ed735df9c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1220 microversion: 2.1 time: 0.673417 Jun 16 16:11:59.350896 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 5/10] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:11:58 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1220 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:11:59.770486 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1198203974", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:11:59.938779 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] validate_networks() for [('84d0c54c-ef5a-4a19-a82f-2cbc7460411e', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:12:01.782891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-484229995", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "networks": [{"uuid": "b0f8736e-a4c9-4c19-b402-ad1b6934beeb"}]}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:02.022924 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.network.neutron [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] validate_networks() for [('b0f8736e-a4c9-4c19-b402-ad1b6934beeb', None, None, None, None, None)] {{(pid=117756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:12:02.800582 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:12:02.801157 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:12:02.805222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:12:02.805841 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:12:02.808685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:12:02.873690 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:02.874175 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:02.875134 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:02.875751 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:02.969904 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Getting quotas for project 6eee49063a5847dba6ffb520d0149d88. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:12:02.996404 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Getting quotas for user 515114f0a842463fb2d1265ee33db8eb and project 6eee49063a5847dba6ffb520d0149d88. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:12:03.070011 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:12:03.094659 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:12:03.414004 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c1a77ca3-76b1-4c33-9759-2921e8e5638e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.648108 Jun 16 16:12:03.414676 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 6/11] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:11:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 3650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:12:04.645898 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7efd03c7-3179-42b7-a0c6-e649d72ecced tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Action: 'create', calling method: .version_select at 0x7f38c13bb670>, body: {"keypair": {"name": "tempest-keypair-179900669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqtsrMbEPTmqc3Rij6alteeuxMlzu0DB2m5u/YDA9d3AXEsEoRkViP1kQ6sShbGaT8OVk/aSu4l20YA4BleXzl1MFtlbL0KBTWMMyrMm97FeFTIAk2KX9BDGbcNRdj1Zg=="}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:04.766940 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-7efd03c7-3179-42b7-a0c6-e649d72ecced tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Getting quotas for project 34323d7e571b4f1db4d6e0c6cd1159cc. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:12:04.790700 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-7efd03c7-3179-42b7-a0c6-e649d72ecced tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Getting quotas for user 80386d7afc994931af05fd49fa8043d6 and project 34323d7e571b4f1db4d6e0c6cd1159cc. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:12:04.986782 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7efd03c7-3179-42b7-a0c6-e649d72ecced tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.548444 Jun 16 16:12:05.004288 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 7/12] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 16:12:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:12:05.049694 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-aa428d18-cb7f-4215-9812-675d6358b83d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:05.072970 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-aa428d18-cb7f-4215-9812-675d6358b83d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:05.879525 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-aa428d18-cb7f-4215-9812-675d6358b83d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:05.925714 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-aa428d18-cb7f-4215-9812-675d6358b83d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1222 microversion: 2.1 time: 0.904915 Jun 16 16:12:05.926362 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 8/13] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:05 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1222 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:07.480715 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f9742144-bf26-4aa1-a979-d02940c2fc54 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Action: 'create', calling method: .version_select at 0x7f38c02fc8b0>, body: {"keypair": {"name": "tempest-keypair-831620920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfeYw6BqH8GwEI8iajXEO7ZfhFQT5ntVcbGuhfbbxM3oduFx59udyzlhsNRFmxjXkZXXYvUi3NHFuBLNI2SRBgSiAPMqChC7GhcE/Wd/tYO7KT7qGjc6mWwZ6exfDthkg=="}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:07.574959 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-f9742144-bf26-4aa1-a979-d02940c2fc54 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for project b091584c67814e4d8f7e88f0596880e3. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:12:07.590794 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-f9742144-bf26-4aa1-a979-d02940c2fc54 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for user 2c34f05634d34da29088bcf75069958d and project b091584c67814e4d8f7e88f0596880e3. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:12:07.738019 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f9742144-bf26-4aa1-a979-d02940c2fc54 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.810464 Jun 16 16:12:07.742980 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 9/14] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 16:12:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:12:07.766464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0e43be50-17bb-4eba-b66b-ba64dd2bbde2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:07.769348 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0e43be50-17bb-4eba-b66b-ba64dd2bbde2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:07.810685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e43be50-17bb-4eba-b66b-ba64dd2bbde2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:07.819994 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e43be50-17bb-4eba-b66b-ba64dd2bbde2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:07.823534 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e43be50-17bb-4eba-b66b-ba64dd2bbde2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:07.827320 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e43be50-17bb-4eba-b66b-ba64dd2bbde2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:08.894674 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Flavor limits 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:12:08.895550 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Image limits 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:12:08.896304 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Flavor pref 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:12:08.897062 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Image pref 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:12:08.901115 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:12:08.937863 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0e43be50-17bb-4eba-b66b-ba64dd2bbde2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:09.015097 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0e43be50-17bb-4eba-b66b-ba64dd2bbde2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1274 microversion: 2.1 time: 1.261901 Jun 16 16:12:09.022746 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 10/15] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:07 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1274 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:09.028459 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:09.032557 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:09.034135 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:09.058508 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:09.342648 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Getting quotas for project 4e4bfae59d38461c839fc9a35eb4d6cf. Resources: {'instances', 'cores', 'ram'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:12:09.357354 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Getting quotas for user 4d48e41e19584c5c8773c9f445355ff2 and project 4e4bfae59d38461c839fc9a35eb4d6cf. Resources: {'instances', 'cores', 'ram'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:12:09.405854 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Going to run 1 instances... {{(pid=117756) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:12:09.412101 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:12:09.774994 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ffe2a8b7-8602-464c-9145-1e881f76017d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.853014 Jun 16 16:12:09.775795 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 6/16] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:12:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 8854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:12:09.801352 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-67cc8106-959f-40df-a9d3-f4fd95e34455 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:09.802957 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-67cc8106-959f-40df-a9d3-f4fd95e34455 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:10.043633 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-525a2e09-48fc-42e0-9c59-fd68d5e818cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:10.044856 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-525a2e09-48fc-42e0-9c59-fd68d5e818cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:10.066312 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-525a2e09-48fc-42e0-9c59-fd68d5e818cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:10.070640 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-525a2e09-48fc-42e0-9c59-fd68d5e818cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:10.072443 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-525a2e09-48fc-42e0-9c59-fd68d5e818cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:10.073163 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-525a2e09-48fc-42e0-9c59-fd68d5e818cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:10.332924 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-67cc8106-959f-40df-a9d3-f4fd95e34455 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:10.343807 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-67cc8106-959f-40df-a9d3-f4fd95e34455 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1214 microversion: 2.1 time: 0.554851 Jun 16 16:12:10.364682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 11/17] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:09 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1214 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:10.867099 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-525a2e09-48fc-42e0-9c59-fd68d5e818cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:10.910057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-525a2e09-48fc-42e0-9c59-fd68d5e818cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1280 microversion: 2.1 time: 0.873374 Jun 16 16:12:10.915049 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 7/18] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:10 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1280 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:11.377980 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f07d94c2-249f-479a-b57e-06b968f3d4a6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:11.379217 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f07d94c2-249f-479a-b57e-06b968f3d4a6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:11.412713 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f07d94c2-249f-479a-b57e-06b968f3d4a6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:11.417452 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f07d94c2-249f-479a-b57e-06b968f3d4a6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:11.424013 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f07d94c2-249f-479a-b57e-06b968f3d4a6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:11.424850 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f07d94c2-249f-479a-b57e-06b968f3d4a6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:11.942506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-104f4d0c-728d-49a7-a4eb-6080d8a439e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:11.943143 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-104f4d0c-728d-49a7-a4eb-6080d8a439e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:11.964217 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-104f4d0c-728d-49a7-a4eb-6080d8a439e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:11.964972 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-104f4d0c-728d-49a7-a4eb-6080d8a439e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:11.965831 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-104f4d0c-728d-49a7-a4eb-6080d8a439e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:11.966379 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-104f4d0c-728d-49a7-a4eb-6080d8a439e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:12.171908 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f07d94c2-249f-479a-b57e-06b968f3d4a6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:12.210668 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f07d94c2-249f-479a-b57e-06b968f3d4a6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1210 microversion: 2.1 time: 0.842689 Jun 16 16:12:12.211818 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 12/19] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:11 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1210 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:12.213082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-104f4d0c-728d-49a7-a4eb-6080d8a439e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:12.260639 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-104f4d0c-728d-49a7-a4eb-6080d8a439e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1280 microversion: 2.1 time: 0.330260 Jun 16 16:12:12.267085 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 8/20] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:11 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1280 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:13.230451 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=4 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:13.236907 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b8a23991-6445-49a8-912a-161726982e21 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:13.237944 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b8a23991-6445-49a8-912a-161726982e21 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:13.281740 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e330faf1-429e-49b0-b170-d6ff2d4ade34 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:13.282493 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e330faf1-429e-49b0-b170-d6ff2d4ade34 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:13.302977 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b8a23991-6445-49a8-912a-161726982e21 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:13.303729 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b8a23991-6445-49a8-912a-161726982e21 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:13.317329 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b8a23991-6445-49a8-912a-161726982e21 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:13.321623 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e330faf1-429e-49b0-b170-d6ff2d4ade34 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:13.323378 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b8a23991-6445-49a8-912a-161726982e21 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:13.330564 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e330faf1-429e-49b0-b170-d6ff2d4ade34 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:13.334320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e330faf1-429e-49b0-b170-d6ff2d4ade34 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:13.335272 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e330faf1-429e-49b0-b170-d6ff2d4ade34 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:14.556531 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b8a23991-6445-49a8-912a-161726982e21 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:14.584732 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b8a23991-6445-49a8-912a-161726982e21 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1284 microversion: 2.1 time: 1.355095 Jun 16 16:12:14.585379 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 13/21] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:13 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1284 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:14.878720 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e330faf1-429e-49b0-b170-d6ff2d4ade34 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:14.912095 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e330faf1-429e-49b0-b170-d6ff2d4ade34 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1280 microversion: 2.1 time: 1.634232 Jun 16 16:12:14.918821 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 9/22] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:13 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1280 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:15.612671 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-be3b6416-57fc-4522-952f-7f157908f05f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:15.613563 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-be3b6416-57fc-4522-952f-7f157908f05f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:15.629525 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-be3b6416-57fc-4522-952f-7f157908f05f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:15.632900 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-be3b6416-57fc-4522-952f-7f157908f05f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:15.635579 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-be3b6416-57fc-4522-952f-7f157908f05f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:15.639723 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-be3b6416-57fc-4522-952f-7f157908f05f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:15.940621 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8da3b50f-2afb-472c-8526-a39bffad598a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:15.946869 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8da3b50f-2afb-472c-8526-a39bffad598a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:15.969037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8da3b50f-2afb-472c-8526-a39bffad598a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:15.972731 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8da3b50f-2afb-472c-8526-a39bffad598a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:15.974350 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8da3b50f-2afb-472c-8526-a39bffad598a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:15.975122 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8da3b50f-2afb-472c-8526-a39bffad598a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:16.137376 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-be3b6416-57fc-4522-952f-7f157908f05f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:16.162337 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-be3b6416-57fc-4522-952f-7f157908f05f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1272 microversion: 2.1 time: 0.561214 Jun 16 16:12:16.166679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 14/23] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:15 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1272 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:17.188709 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-62c08bbf-7a88-44e5-80fb-fb8a188e0627 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:17.189583 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-62c08bbf-7a88-44e5-80fb-fb8a188e0627 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:17.220270 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62c08bbf-7a88-44e5-80fb-fb8a188e0627 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:17.226716 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62c08bbf-7a88-44e5-80fb-fb8a188e0627 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:17.230372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62c08bbf-7a88-44e5-80fb-fb8a188e0627 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:17.233039 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-62c08bbf-7a88-44e5-80fb-fb8a188e0627 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:17.451514 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8da3b50f-2afb-472c-8526-a39bffad598a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:17.471640 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8da3b50f-2afb-472c-8526-a39bffad598a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 1.534891 Jun 16 16:12:17.474954 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 10/24] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:15 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:18.147468 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-62c08bbf-7a88-44e5-80fb-fb8a188e0627 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:18.203105 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-62c08bbf-7a88-44e5-80fb-fb8a188e0627 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1272 microversion: 2.1 time: 1.018125 Jun 16 16:12:18.209266 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 15/25] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:17 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1272 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:18.497423 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d81bb0e6-2e35-4ee5-9cf9-dca7d4441ff0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:18.499951 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d81bb0e6-2e35-4ee5-9cf9-dca7d4441ff0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:18.524972 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d81bb0e6-2e35-4ee5-9cf9-dca7d4441ff0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:18.534334 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d81bb0e6-2e35-4ee5-9cf9-dca7d4441ff0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:18.538836 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d81bb0e6-2e35-4ee5-9cf9-dca7d4441ff0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:18.545485 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d81bb0e6-2e35-4ee5-9cf9-dca7d4441ff0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:18.848575 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-914854721", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "abdff458-150a-4302-aaae-af8beb5c788c"}], "security_groups": [{"name": "tempest-securitygroup--287412028"}], "key_name": "tempest-keypair-179900669", "user_data": "}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:19.230230 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:19.392736 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=8 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:19.980051 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] validate_networks() for [('abdff458-150a-4302-aaae-af8beb5c788c', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:12:20.338373 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=24 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:20.891857 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d81bb0e6-2e35-4ee5-9cf9-dca7d4441ff0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:20.902142 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d81bb0e6-2e35-4ee5-9cf9-dca7d4441ff0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 2.413577 Jun 16 16:12:20.903337 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 11/26] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:18 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 2416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:20.915309 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d8bc9d62-e4e9-47c3-b325-9411237d9fb9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:20.917108 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d8bc9d62-e4e9-47c3-b325-9411237d9fb9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:20.927204 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d8bc9d62-e4e9-47c3-b325-9411237d9fb9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:20.928153 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d8bc9d62-e4e9-47c3-b325-9411237d9fb9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:20.929537 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d8bc9d62-e4e9-47c3-b325-9411237d9fb9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:20.930785 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d8bc9d62-e4e9-47c3-b325-9411237d9fb9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:22.232257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d8bc9d62-e4e9-47c3-b325-9411237d9fb9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:22.260009 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d8bc9d62-e4e9-47c3-b325-9411237d9fb9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 1.354306 Jun 16 16:12:22.267412 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 12/27] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:20 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:22.559046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:12:22.560573 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:12:22.561121 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:12:22.561543 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:12:22.561978 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:12:22.619049 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:22.619582 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:22.620399 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:22.620842 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:22.704895 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Getting quotas for project 34323d7e571b4f1db4d6e0c6cd1159cc. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:12:22.721296 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-047881fa-6446-44d4-882c-2006a1818d00 req-3d0a18cc-031c-4f29-b696-5420999d1fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83df7777-6291-4644-a893-e1359c012b9f", "tag": "4a474085-3880-4331-a44c-eaa67f0578be"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:22.741373 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Getting quotas for user 80386d7afc994931af05fd49fa8043d6 and project 34323d7e571b4f1db4d6e0c6cd1159cc. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:12:22.761003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-047881fa-6446-44d4-882c-2006a1818d00 req-3d0a18cc-031c-4f29-b696-5420999d1fd0 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:22.781992 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-047881fa-6446-44d4-882c-2006a1818d00 req-3d0a18cc-031c-4f29-b696-5420999d1fd0 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:22.797268 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:12:22.803507 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:12:22.848988 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-047881fa-6446-44d4-882c-2006a1818d00 req-3d0a18cc-031c-4f29-b696-5420999d1fd0 service nova] Creating event network-changed:4a474085-3880-4331-a44c-eaa67f0578be for instance 83df7777-6291-4644-a893-e1359c012b9f on hv-cinder-83716 Jun 16 16:12:22.852954 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-047881fa-6446-44d4-882c-2006a1818d00 req-3d0a18cc-031c-4f29-b696-5420999d1fd0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117756) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 16:12:22.861759 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-60c7d9e8-116e-46ec-9e8d-678909e2d74b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:22.864296 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-60c7d9e8-116e-46ec-9e8d-678909e2d74b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:22.873809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-60c7d9e8-116e-46ec-9e8d-678909e2d74b None None] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:22.877639 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-60c7d9e8-116e-46ec-9e8d-678909e2d74b None None] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:22.917077 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.compute.rpcapi [None req-60c7d9e8-116e-46ec-9e8d-678909e2d74b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 16:12:22.924100 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-60c7d9e8-116e-46ec-9e8d-678909e2d74b None None] Releasing lock "compute-rpcapi-router" {{(pid=117756) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 16:12:22.985651 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1f45bc86-b834-4dc9-a3ac-5d9bc810f854 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.146592 Jun 16 16:12:22.987555 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 16/28] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:12:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 4149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:12:22.995067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-50f06168-a844-4904-9efb-faf3163ecd5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:22.996340 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-50f06168-a844-4904-9efb-faf3163ecd5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:23.001828 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-60c7d9e8-116e-46ec-9e8d-678909e2d74b None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.728725 Jun 16 16:12:23.003673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 13/29] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:12:23.023475 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-50f06168-a844-4904-9efb-faf3163ecd5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:23.024492 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-480000401", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cdb4f4d1-8b7f-401f-9aab-5045d67bace2"}], "security_groups": [{"name": "tempest-securitygroup--267307587"}], "key_name": "tempest-keypair-831620920", "user_data": "}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:23.025031 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-50f06168-a844-4904-9efb-faf3163ecd5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:23.055147 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-50f06168-a844-4904-9efb-faf3163ecd5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:23.061002 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-50f06168-a844-4904-9efb-faf3163ecd5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:23.592521 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.network.neutron [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] validate_networks() for [('cdb4f4d1-8b7f-401f-9aab-5045d67bace2', None, None, None, None, None)] {{(pid=117756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:12:23.660477 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-50f06168-a844-4904-9efb-faf3163ecd5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:23.690727 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-50f06168-a844-4904-9efb-faf3163ecd5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.690854 Jun 16 16:12:23.691407 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 17/30] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:22 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:23.720371 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8f39bfbc-b2b3-4d3c-ae52-cfd5c7f21636 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:23.721004 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8f39bfbc-b2b3-4d3c-ae52-cfd5c7f21636 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:23.837259 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8f39bfbc-b2b3-4d3c-ae52-cfd5c7f21636 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:23.845679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8f39bfbc-b2b3-4d3c-ae52-cfd5c7f21636 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1236 microversion: 2.1 time: 0.133964 Jun 16 16:12:23.846522 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 18/31] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:23 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1236 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:23.855614 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-122594bb-be82-4b20-bd31-e5357ab91009 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:23.857200 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-122594bb-be82-4b20-bd31-e5357ab91009 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:23.861490 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:23.865712 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-122594bb-be82-4b20-bd31-e5357ab91009 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:23.866386 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-122594bb-be82-4b20-bd31-e5357ab91009 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:23.867628 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-122594bb-be82-4b20-bd31-e5357ab91009 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:23.868213 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-122594bb-be82-4b20-bd31-e5357ab91009 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:24.236427 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-122594bb-be82-4b20-bd31-e5357ab91009 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:24.238711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=47 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:24.246085 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-122594bb-be82-4b20-bd31-e5357ab91009 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.396502 Jun 16 16:12:24.247764 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 19/32] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:23 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:24.711777 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0fcaeb87-acf7-43c6-8edd-00e5e854deb1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:24.713469 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0fcaeb87-acf7-43c6-8edd-00e5e854deb1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:24.727708 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0fcaeb87-acf7-43c6-8edd-00e5e854deb1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:24.732101 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0fcaeb87-acf7-43c6-8edd-00e5e854deb1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:24.734932 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0fcaeb87-acf7-43c6-8edd-00e5e854deb1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:24.736858 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0fcaeb87-acf7-43c6-8edd-00e5e854deb1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:24.969894 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0fcaeb87-acf7-43c6-8edd-00e5e854deb1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:25.004232 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0fcaeb87-acf7-43c6-8edd-00e5e854deb1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.297597 Jun 16 16:12:25.006283 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 20/33] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:24 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:25.212997 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Flavor limits 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:12:25.213801 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Image limits 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:12:25.214730 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Flavor pref 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:12:25.215958 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Image pref 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:12:25.216623 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:12:25.222778 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-9315938a-d6fb-42b0-adf2-0fb529f8f4dd req-4e7312e4-05e6-435e-88e9-59e123c74e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5", "tag": "ecd1c4fc-716d-40aa-81c3-83ee9f284517"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:25.230349 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:25.231816 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:25.233045 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:25.233701 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:25.235226 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-9315938a-d6fb-42b0-adf2-0fb529f8f4dd req-4e7312e4-05e6-435e-88e9-59e123c74e67 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:25.235674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-9315938a-d6fb-42b0-adf2-0fb529f8f4dd req-4e7312e4-05e6-435e-88e9-59e123c74e67 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:25.256978 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-9315938a-d6fb-42b0-adf2-0fb529f8f4dd req-4e7312e4-05e6-435e-88e9-59e123c74e67 service nova] Creating event network-changed:ecd1c4fc-716d-40aa-81c3-83ee9f284517 for instance fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 on hv-cinder-83716 Jun 16 16:12:25.257517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-9315938a-d6fb-42b0-adf2-0fb529f8f4dd req-4e7312e4-05e6-435e-88e9-59e123c74e67 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117755) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 16:12:25.259064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8c1898c-6174-4b27-83fe-cb51e05932c3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:25.259510 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8c1898c-6174-4b27-83fe-cb51e05932c3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:25.260303 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8c1898c-6174-4b27-83fe-cb51e05932c3 None None] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:25.260733 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8c1898c-6174-4b27-83fe-cb51e05932c3 None None] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:25.265874 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for project b091584c67814e4d8f7e88f0596880e3. Resources: {'instances', 'cores', 'ram'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:12:25.270945 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for user 2c34f05634d34da29088bcf75069958d and project b091584c67814e4d8f7e88f0596880e3. Resources: {'instances', 'cores', 'ram'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:12:25.272736 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.compute.rpcapi [None req-e8c1898c-6174-4b27-83fe-cb51e05932c3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 16:12:25.273807 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e8c1898c-6174-4b27-83fe-cb51e05932c3 None None] Releasing lock "compute-rpcapi-router" {{(pid=117755) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 16:12:25.292078 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e8c1898c-6174-4b27-83fe-cb51e05932c3 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.283016 Jun 16 16:12:25.293591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 21/34] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:12:25.299049 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Going to run 1 instances... {{(pid=117756) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:12:25.301860 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-641ed7f0-cd3f-4a11-a974-36dd290c6dea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:25.302407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:12:25.302625 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-641ed7f0-cd3f-4a11-a974-36dd290c6dea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:25.320768 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-641ed7f0-cd3f-4a11-a974-36dd290c6dea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:25.321658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-641ed7f0-cd3f-4a11-a974-36dd290c6dea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:25.322602 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-641ed7f0-cd3f-4a11-a974-36dd290c6dea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:25.323015 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-641ed7f0-cd3f-4a11-a974-36dd290c6dea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:25.367273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b60bc3af-6d4e-4316-a87b-136b263eb06a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.362363 Jun 16 16:12:25.373519 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 14/35] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:12:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 2370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:12:25.379400 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7061a897-75d0-4ae8-8640-351c3e835159 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:25.380269 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7061a897-75d0-4ae8-8640-351c3e835159 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:25.402919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7061a897-75d0-4ae8-8640-351c3e835159 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:25.404549 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7061a897-75d0-4ae8-8640-351c3e835159 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:25.406734 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7061a897-75d0-4ae8-8640-351c3e835159 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:25.407230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-641ed7f0-cd3f-4a11-a974-36dd290c6dea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:25.407645 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7061a897-75d0-4ae8-8640-351c3e835159 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:25.430069 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-641ed7f0-cd3f-4a11-a974-36dd290c6dea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1240 microversion: 2.1 time: 0.133874 Jun 16 16:12:25.430748 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 22/36] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:25 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1240 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:25.437511 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-005ac87f-e36a-48e7-ab0e-8d213da6bc58 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:25.445764 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-005ac87f-e36a-48e7-ab0e-8d213da6bc58 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:25.518326 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-005ac87f-e36a-48e7-ab0e-8d213da6bc58 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:25.531612 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-005ac87f-e36a-48e7-ab0e-8d213da6bc58 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1240 microversion: 2.1 time: 0.093678 Jun 16 16:12:25.532348 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 23/37] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:25 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1240 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:25.632362 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7061a897-75d0-4ae8-8640-351c3e835159 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:25.642310 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7061a897-75d0-4ae8-8640-351c3e835159 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.267240 Jun 16 16:12:25.643333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 15/38] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:25 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:26.027756 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1da43590-ef25-41f6-83f9-79170bbc9171 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:26.028549 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1da43590-ef25-41f6-83f9-79170bbc9171 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:26.037265 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1da43590-ef25-41f6-83f9-79170bbc9171 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:26.037905 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1da43590-ef25-41f6-83f9-79170bbc9171 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:26.038852 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1da43590-ef25-41f6-83f9-79170bbc9171 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:26.039419 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1da43590-ef25-41f6-83f9-79170bbc9171 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:26.462209 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e00b02f3-eac3-4458-9076-913a4fe79304 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:26.464544 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e00b02f3-eac3-4458-9076-913a4fe79304 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:26.491970 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e00b02f3-eac3-4458-9076-913a4fe79304 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:26.495301 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e00b02f3-eac3-4458-9076-913a4fe79304 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:26.498661 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e00b02f3-eac3-4458-9076-913a4fe79304 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:26.500003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e00b02f3-eac3-4458-9076-913a4fe79304 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:26.630711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1da43590-ef25-41f6-83f9-79170bbc9171 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:26.645573 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1da43590-ef25-41f6-83f9-79170bbc9171 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.624644 Jun 16 16:12:26.646221 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 24/39] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:26 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:26.651259 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-42e5814c-8647-48aa-bfee-a43c370ca13a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:26.651881 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-42e5814c-8647-48aa-bfee-a43c370ca13a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:26.666410 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42e5814c-8647-48aa-bfee-a43c370ca13a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:26.667212 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42e5814c-8647-48aa-bfee-a43c370ca13a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:26.668461 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42e5814c-8647-48aa-bfee-a43c370ca13a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:26.670547 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42e5814c-8647-48aa-bfee-a43c370ca13a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:26.687302 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e00b02f3-eac3-4458-9076-913a4fe79304 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:26.695831 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e00b02f3-eac3-4458-9076-913a4fe79304 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1240 microversion: 2.1 time: 0.247960 Jun 16 16:12:26.697046 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 16/40] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:26 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1240 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:26.704286 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ea57b35a-d434-4390-ac39-207a5ecb81ae tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:26.706021 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ea57b35a-d434-4390-ac39-207a5ecb81ae tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:26.713412 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ea57b35a-d434-4390-ac39-207a5ecb81ae tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:26.714143 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ea57b35a-d434-4390-ac39-207a5ecb81ae tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:26.714914 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ea57b35a-d434-4390-ac39-207a5ecb81ae tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:26.715351 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ea57b35a-d434-4390-ac39-207a5ecb81ae tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:26.758528 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-42e5814c-8647-48aa-bfee-a43c370ca13a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:26.767978 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-42e5814c-8647-48aa-bfee-a43c370ca13a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1236 microversion: 2.1 time: 0.120204 Jun 16 16:12:26.768188 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 25/41] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:26 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1236 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:26.865147 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ea57b35a-d434-4390-ac39-207a5ecb81ae tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:26.872701 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ea57b35a-d434-4390-ac39-207a5ecb81ae tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.174431 Jun 16 16:12:26.873270 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 17/42] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:26 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:27.328083 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-7c9fecdd-4c1f-4d70-8814-5cd3d015a5f7 req-0c359ac5-67e4-4252-ab8e-db709e50f80d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179d422e-be19-4c93-ad79-136aeb12c79a", "tag": "c019be23-ca59-4fbc-9e0d-aaca2c69887b"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:27.345079 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-7c9fecdd-4c1f-4d70-8814-5cd3d015a5f7 req-0c359ac5-67e4-4252-ab8e-db709e50f80d service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:27.347944 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-7c9fecdd-4c1f-4d70-8814-5cd3d015a5f7 req-0c359ac5-67e4-4252-ab8e-db709e50f80d service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:27.361888 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-7c9fecdd-4c1f-4d70-8814-5cd3d015a5f7 req-0c359ac5-67e4-4252-ab8e-db709e50f80d service nova] Creating event network-changed:c019be23-ca59-4fbc-9e0d-aaca2c69887b for instance 179d422e-be19-4c93-ad79-136aeb12c79a on hv-cinder-83716 Jun 16 16:12:27.378734 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-7c9fecdd-4c1f-4d70-8814-5cd3d015a5f7 req-0c359ac5-67e4-4252-ab8e-db709e50f80d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053513 Jun 16 16:12:27.380713 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 26/43] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:12:27.665194 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8d8d2100-5ff0-4add-8d8c-1ed60fd5faed tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:27.665880 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8d8d2100-5ff0-4add-8d8c-1ed60fd5faed tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:27.672426 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8d8d2100-5ff0-4add-8d8c-1ed60fd5faed tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:27.672885 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8d8d2100-5ff0-4add-8d8c-1ed60fd5faed tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:27.673671 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8d8d2100-5ff0-4add-8d8c-1ed60fd5faed tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:27.674142 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8d8d2100-5ff0-4add-8d8c-1ed60fd5faed tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:27.726898 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8a4a4096-8387-490f-8824-4eb4d321c44f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:27.728687 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8a4a4096-8387-490f-8824-4eb4d321c44f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:27.743883 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a4a4096-8387-490f-8824-4eb4d321c44f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:27.744883 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a4a4096-8387-490f-8824-4eb4d321c44f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:27.745942 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a4a4096-8387-490f-8824-4eb4d321c44f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:27.746515 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a4a4096-8387-490f-8824-4eb4d321c44f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:27.839485 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8a4a4096-8387-490f-8824-4eb4d321c44f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:27.850552 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8a4a4096-8387-490f-8824-4eb4d321c44f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1240 microversion: 2.1 time: 0.130136 Jun 16 16:12:27.861531 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 27/44] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:27 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1240 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:27.867353 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ff494d88-1424-4dbb-b979-f97965c5ecb3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:27.868128 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ff494d88-1424-4dbb-b979-f97965c5ecb3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:27.877093 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ff494d88-1424-4dbb-b979-f97965c5ecb3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:27.877775 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ff494d88-1424-4dbb-b979-f97965c5ecb3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:27.878978 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ff494d88-1424-4dbb-b979-f97965c5ecb3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:27.879959 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ff494d88-1424-4dbb-b979-f97965c5ecb3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:27.889972 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8d8d2100-5ff0-4add-8d8c-1ed60fd5faed tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:27.898711 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8d8d2100-5ff0-4add-8d8c-1ed60fd5faed tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.238444 Jun 16 16:12:27.899416 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 18/45] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:27 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:27.906550 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-63b3c100-2353-426d-8fc9-7cebcd8f3b5a tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:27.906974 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-63b3c100-2353-426d-8fc9-7cebcd8f3b5a tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:27.915657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-63b3c100-2353-426d-8fc9-7cebcd8f3b5a tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:27.916243 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-63b3c100-2353-426d-8fc9-7cebcd8f3b5a tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:27.917511 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-63b3c100-2353-426d-8fc9-7cebcd8f3b5a tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:27.918278 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-63b3c100-2353-426d-8fc9-7cebcd8f3b5a tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:28.097768 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ff494d88-1424-4dbb-b979-f97965c5ecb3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:28.112324 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ff494d88-1424-4dbb-b979-f97965c5ecb3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1236 microversion: 2.1 time: 0.245050 Jun 16 16:12:28.113275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 28/46] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:27 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1236 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:28.512048 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-63b3c100-2353-426d-8fc9-7cebcd8f3b5a tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:28.520637 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-63b3c100-2353-426d-8fc9-7cebcd8f3b5a tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.619877 Jun 16 16:12:28.521752 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 19/47] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:27 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:28.868184 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-503335d4-6400-4f82-8ee0-cb7c1272fb9a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:28.868800 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-503335d4-6400-4f82-8ee0-cb7c1272fb9a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:28.876548 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-503335d4-6400-4f82-8ee0-cb7c1272fb9a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:28.877001 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-503335d4-6400-4f82-8ee0-cb7c1272fb9a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:28.877788 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-503335d4-6400-4f82-8ee0-cb7c1272fb9a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:28.878265 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-503335d4-6400-4f82-8ee0-cb7c1272fb9a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:28.916817 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fd026d0a-f33e-4770-8acf-f2da6649e4c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:28.917447 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-fd026d0a-f33e-4770-8acf-f2da6649e4c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:28.920105 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:28.927443 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fd026d0a-f33e-4770-8acf-f2da6649e4c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:28.927920 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fd026d0a-f33e-4770-8acf-f2da6649e4c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:28.929989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fd026d0a-f33e-4770-8acf-f2da6649e4c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:28.929989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fd026d0a-f33e-4770-8acf-f2da6649e4c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:28.947827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-503335d4-6400-4f82-8ee0-cb7c1272fb9a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:28.956309 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-503335d4-6400-4f82-8ee0-cb7c1272fb9a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1288 microversion: 2.1 time: 0.091987 Jun 16 16:12:28.956890 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 29/48] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:28 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:29.072017 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fd026d0a-f33e-4770-8acf-f2da6649e4c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:29.080081 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fd026d0a-f33e-4770-8acf-f2da6649e4c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.167021 Jun 16 16:12:29.080650 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 20/49] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:28 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:29.134030 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a82a7348-4f84-4a3b-a8b7-0f18c9243881 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:29.134681 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a82a7348-4f84-4a3b-a8b7-0f18c9243881 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:29.141303 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a82a7348-4f84-4a3b-a8b7-0f18c9243881 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:29.141762 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a82a7348-4f84-4a3b-a8b7-0f18c9243881 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:29.142572 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a82a7348-4f84-4a3b-a8b7-0f18c9243881 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:29.143013 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a82a7348-4f84-4a3b-a8b7-0f18c9243881 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:29.203997 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a82a7348-4f84-4a3b-a8b7-0f18c9243881 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:29.211546 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a82a7348-4f84-4a3b-a8b7-0f18c9243881 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1292 microversion: 2.1 time: 0.082353 Jun 16 16:12:29.212116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 30/50] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:29 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:29.538961 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d91388af-148f-4909-aac4-956c94c882d6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:29.539510 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d91388af-148f-4909-aac4-956c94c882d6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:29.546519 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d91388af-148f-4909-aac4-956c94c882d6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:29.546983 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d91388af-148f-4909-aac4-956c94c882d6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:29.547766 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d91388af-148f-4909-aac4-956c94c882d6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:29.548211 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d91388af-148f-4909-aac4-956c94c882d6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:29.858173 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d91388af-148f-4909-aac4-956c94c882d6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:29.865998 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d91388af-148f-4909-aac4-956c94c882d6 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.331187 Jun 16 16:12:29.866576 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 21/51] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:29 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:29.974167 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-50b9010f-1e6f-4a75-8d8a-74c2f3060dc0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:29.974784 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-50b9010f-1e6f-4a75-8d8a-74c2f3060dc0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:29.980863 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-50b9010f-1e6f-4a75-8d8a-74c2f3060dc0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:29.981311 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-50b9010f-1e6f-4a75-8d8a-74c2f3060dc0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:29.982466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-50b9010f-1e6f-4a75-8d8a-74c2f3060dc0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:29.982899 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-50b9010f-1e6f-4a75-8d8a-74c2f3060dc0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:30.050067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-50b9010f-1e6f-4a75-8d8a-74c2f3060dc0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:30.063599 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-50b9010f-1e6f-4a75-8d8a-74c2f3060dc0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1288 microversion: 2.1 time: 0.092900 Jun 16 16:12:30.064475 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 31/52] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:29 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1288 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:30.100760 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7ff7f9f6-7851-4899-81f3-6be148c0cd2a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:30.101374 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7ff7f9f6-7851-4899-81f3-6be148c0cd2a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:30.107957 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7ff7f9f6-7851-4899-81f3-6be148c0cd2a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:30.108419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7ff7f9f6-7851-4899-81f3-6be148c0cd2a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:30.109237 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7ff7f9f6-7851-4899-81f3-6be148c0cd2a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:30.109678 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7ff7f9f6-7851-4899-81f3-6be148c0cd2a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:30.228757 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fc6466e8-7eec-4e45-8117-1b3ff5ed5667 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:30.229631 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fc6466e8-7eec-4e45-8117-1b3ff5ed5667 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:30.236385 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fc6466e8-7eec-4e45-8117-1b3ff5ed5667 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:30.236763 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fc6466e8-7eec-4e45-8117-1b3ff5ed5667 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:30.237558 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fc6466e8-7eec-4e45-8117-1b3ff5ed5667 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:30.238656 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fc6466e8-7eec-4e45-8117-1b3ff5ed5667 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:30.254592 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7ff7f9f6-7851-4899-81f3-6be148c0cd2a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:30.264400 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7ff7f9f6-7851-4899-81f3-6be148c0cd2a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.167485 Jun 16 16:12:30.264995 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 22/53] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:30 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:30.311945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fc6466e8-7eec-4e45-8117-1b3ff5ed5667 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:30.319696 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fc6466e8-7eec-4e45-8117-1b3ff5ed5667 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1292 microversion: 2.1 time: 0.094874 Jun 16 16:12:30.320287 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 32/54] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:30 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:30.882946 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f33f9fe6-ac60-4a06-b7da-03b34396add9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:30.883587 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f33f9fe6-ac60-4a06-b7da-03b34396add9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:30.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f33f9fe6-ac60-4a06-b7da-03b34396add9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:30.890755 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f33f9fe6-ac60-4a06-b7da-03b34396add9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:30.891548 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f33f9fe6-ac60-4a06-b7da-03b34396add9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:30.891989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f33f9fe6-ac60-4a06-b7da-03b34396add9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:31.057332 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f33f9fe6-ac60-4a06-b7da-03b34396add9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:31.067861 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f33f9fe6-ac60-4a06-b7da-03b34396add9 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.188850 Jun 16 16:12:31.068636 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 23/55] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:30 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:31.093042 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-21f2ea8f-026e-41ca-be69-1ce4c535b472 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:31.094171 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-21f2ea8f-026e-41ca-be69-1ce4c535b472 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:31.104594 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-21f2ea8f-026e-41ca-be69-1ce4c535b472 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:31.105225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-21f2ea8f-026e-41ca-be69-1ce4c535b472 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:31.106710 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-21f2ea8f-026e-41ca-be69-1ce4c535b472 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:31.107655 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-21f2ea8f-026e-41ca-be69-1ce4c535b472 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:31.213918 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-21f2ea8f-026e-41ca-be69-1ce4c535b472 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:31.227960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-21f2ea8f-026e-41ca-be69-1ce4c535b472 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1288 microversion: 2.1 time: 0.142425 Jun 16 16:12:31.228960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 33/56] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:31 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1288 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:31.282860 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3e64ae45-0b91-41eb-923f-ae6815ebf4ba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:31.283670 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3e64ae45-0b91-41eb-923f-ae6815ebf4ba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:31.290443 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3e64ae45-0b91-41eb-923f-ae6815ebf4ba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:31.290915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3e64ae45-0b91-41eb-923f-ae6815ebf4ba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:31.292426 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3e64ae45-0b91-41eb-923f-ae6815ebf4ba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:31.292980 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3e64ae45-0b91-41eb-923f-ae6815ebf4ba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:31.298579 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=100 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:31.338222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7ac8657a-f5a7-4ed4-8f46-1a4a1e65fe08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:31.340508 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7ac8657a-f5a7-4ed4-8f46-1a4a1e65fe08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:31.353450 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7ac8657a-f5a7-4ed4-8f46-1a4a1e65fe08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:31.355079 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7ac8657a-f5a7-4ed4-8f46-1a4a1e65fe08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:31.357049 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7ac8657a-f5a7-4ed4-8f46-1a4a1e65fe08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:31.358465 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7ac8657a-f5a7-4ed4-8f46-1a4a1e65fe08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:31.600748 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7ac8657a-f5a7-4ed4-8f46-1a4a1e65fe08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:31.613538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7ac8657a-f5a7-4ed4-8f46-1a4a1e65fe08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1292 microversion: 2.1 time: 0.280438 Jun 16 16:12:31.620417 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 34/57] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:31 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1292 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:32.099531 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6d625866-df74-477d-9c48-e183b58b33ba tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:32.103854 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6d625866-df74-477d-9c48-e183b58b33ba tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:32.163024 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d625866-df74-477d-9c48-e183b58b33ba tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:32.164616 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d625866-df74-477d-9c48-e183b58b33ba tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:32.165742 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d625866-df74-477d-9c48-e183b58b33ba tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:32.166379 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d625866-df74-477d-9c48-e183b58b33ba tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:32.263752 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3e64ae45-0b91-41eb-923f-ae6815ebf4ba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:32.280573 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3e64ae45-0b91-41eb-923f-ae6815ebf4ba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 1.002717 Jun 16 16:12:32.281810 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 24/58] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:31 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:32.289950 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-07656245-7b73-4bdc-af3a-17e7e0704c70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:32.299088 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-07656245-7b73-4bdc-af3a-17e7e0704c70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:32.307897 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-07656245-7b73-4bdc-af3a-17e7e0704c70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:32.310502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-07656245-7b73-4bdc-af3a-17e7e0704c70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:32.311496 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-07656245-7b73-4bdc-af3a-17e7e0704c70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:32.313294 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-07656245-7b73-4bdc-af3a-17e7e0704c70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:32.471985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-07656245-7b73-4bdc-af3a-17e7e0704c70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:32.487330 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-07656245-7b73-4bdc-af3a-17e7e0704c70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1294 microversion: 2.1 time: 0.200432 Jun 16 16:12:32.489445 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 25/59] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:32 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1294 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:32.642185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d6ee83f2-0e3b-41e4-8c2b-a3db114ef79f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:32.644082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d6ee83f2-0e3b-41e4-8c2b-a3db114ef79f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:32.670542 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d6ee83f2-0e3b-41e4-8c2b-a3db114ef79f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:32.671751 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d6ee83f2-0e3b-41e4-8c2b-a3db114ef79f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:32.676821 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d6ee83f2-0e3b-41e4-8c2b-a3db114ef79f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:32.677906 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d6ee83f2-0e3b-41e4-8c2b-a3db114ef79f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:32.838673 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6d625866-df74-477d-9c48-e183b58b33ba tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:32.865474 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6d625866-df74-477d-9c48-e183b58b33ba tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.773847 Jun 16 16:12:32.875070 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 35/60] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:32 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:32.985860 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d6ee83f2-0e3b-41e4-8c2b-a3db114ef79f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:32.994711 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d6ee83f2-0e3b-41e4-8c2b-a3db114ef79f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1298 microversion: 2.1 time: 0.359031 Jun 16 16:12:32.995355 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 26/61] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:32 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1298 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:33.300191 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ca5da558-b895-4eef-b1de-bf57ea0f46d0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:33.300895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ca5da558-b895-4eef-b1de-bf57ea0f46d0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:33.315052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ca5da558-b895-4eef-b1de-bf57ea0f46d0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:33.317468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ca5da558-b895-4eef-b1de-bf57ea0f46d0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:33.319861 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ca5da558-b895-4eef-b1de-bf57ea0f46d0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:33.320715 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ca5da558-b895-4eef-b1de-bf57ea0f46d0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:33.495339 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-fe620fa6-c4c4-4854-9817-347ce12c7900 req-0776be58-77c7-4f7c-9c51-3c2ce2a226be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83df7777-6291-4644-a893-e1359c012b9f", "name": "network-vif-plugged", "status": "completed", "tag": "4a474085-3880-4331-a44c-eaa67f0578be"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:33.509116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-fe620fa6-c4c4-4854-9817-347ce12c7900 req-0776be58-77c7-4f7c-9c51-3c2ce2a226be service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:33.509950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-fe620fa6-c4c4-4854-9817-347ce12c7900 req-0776be58-77c7-4f7c-9c51-3c2ce2a226be service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:33.531961 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-fe620fa6-c4c4-4854-9817-347ce12c7900 req-0776be58-77c7-4f7c-9c51-3c2ce2a226be service nova] Creating event network-vif-plugged:4a474085-3880-4331-a44c-eaa67f0578be for instance 83df7777-6291-4644-a893-e1359c012b9f on hv-cinder-83716 Jun 16 16:12:33.541068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-fe620fa6-c4c4-4854-9817-347ce12c7900 req-0776be58-77c7-4f7c-9c51-3c2ce2a226be service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.317240 Jun 16 16:12:33.542201 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 36/62] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:12:33.563807 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-afcc86cc-8cee-4b1a-979f-5a7124452827 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:33.565617 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-afcc86cc-8cee-4b1a-979f-5a7124452827 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:33.579925 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-afcc86cc-8cee-4b1a-979f-5a7124452827 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:33.580692 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-afcc86cc-8cee-4b1a-979f-5a7124452827 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:33.582416 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-afcc86cc-8cee-4b1a-979f-5a7124452827 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:33.583296 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-afcc86cc-8cee-4b1a-979f-5a7124452827 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:33.622473 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ca5da558-b895-4eef-b1de-bf57ea0f46d0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:33.631033 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ca5da558-b895-4eef-b1de-bf57ea0f46d0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.335417 Jun 16 16:12:33.634987 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 27/63] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:33 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:33.711741 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-afcc86cc-8cee-4b1a-979f-5a7124452827 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:33.723999 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-afcc86cc-8cee-4b1a-979f-5a7124452827 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1294 microversion: 2.1 time: 0.180192 Jun 16 16:12:33.724798 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 37/64] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:33 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1294 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:33.895444 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f2b821f1-e8e7-4004-899a-6a437c17a0f8 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:33.895707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f2b821f1-e8e7-4004-899a-6a437c17a0f8 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:33.912018 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f2b821f1-e8e7-4004-899a-6a437c17a0f8 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:33.912479 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f2b821f1-e8e7-4004-899a-6a437c17a0f8 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:33.913505 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f2b821f1-e8e7-4004-899a-6a437c17a0f8 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:33.914683 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f2b821f1-e8e7-4004-899a-6a437c17a0f8 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:34.021717 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9b82c27e-05d2-488d-b82d-ed7c1952d55a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:34.023906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9b82c27e-05d2-488d-b82d-ed7c1952d55a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:34.040531 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9b82c27e-05d2-488d-b82d-ed7c1952d55a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:34.042000 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9b82c27e-05d2-488d-b82d-ed7c1952d55a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:34.044573 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9b82c27e-05d2-488d-b82d-ed7c1952d55a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:34.046933 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9b82c27e-05d2-488d-b82d-ed7c1952d55a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:34.895500 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9b82c27e-05d2-488d-b82d-ed7c1952d55a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:34.908719 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9b82c27e-05d2-488d-b82d-ed7c1952d55a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.888677 Jun 16 16:12:34.923176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 38/65] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:34 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:34.923944 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a3b81842-8285-40bf-8c01-6a5c93d11a52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:34.924643 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a3b81842-8285-40bf-8c01-6a5c93d11a52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:34.931088 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a3b81842-8285-40bf-8c01-6a5c93d11a52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:34.931685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a3b81842-8285-40bf-8c01-6a5c93d11a52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:34.945501 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a3b81842-8285-40bf-8c01-6a5c93d11a52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:34.946126 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a3b81842-8285-40bf-8c01-6a5c93d11a52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:34.955464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=100 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:35.029241 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f2b821f1-e8e7-4004-899a-6a437c17a0f8 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:35.050877 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f2b821f1-e8e7-4004-899a-6a437c17a0f8 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 1.154799 Jun 16 16:12:35.063898 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 28/66] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:33 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:35.075026 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c60c6932-eb5b-4e31-91cc-9091dc448905 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:35.076039 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c60c6932-eb5b-4e31-91cc-9091dc448905 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:35.084684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c60c6932-eb5b-4e31-91cc-9091dc448905 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:35.085346 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c60c6932-eb5b-4e31-91cc-9091dc448905 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:35.086431 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c60c6932-eb5b-4e31-91cc-9091dc448905 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:35.087043 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c60c6932-eb5b-4e31-91cc-9091dc448905 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:35.199269 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a3b81842-8285-40bf-8c01-6a5c93d11a52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:35.214902 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a3b81842-8285-40bf-8c01-6a5c93d11a52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.295302 Jun 16 16:12:35.216167 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 39/67] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:34 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:35.247718 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=4 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:35.291814 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=6 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:35.398693 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c60c6932-eb5b-4e31-91cc-9091dc448905 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:35.412381 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c60c6932-eb5b-4e31-91cc-9091dc448905 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.346460 Jun 16 16:12:35.413391 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 29/68] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:35 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:35.929709 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8f79edbf-a415-48cb-879c-916f9917c397 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:35.930521 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8f79edbf-a415-48cb-879c-916f9917c397 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:35.932590 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=4 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:35.933358 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=10 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:35.944035 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f79edbf-a415-48cb-879c-916f9917c397 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:35.944784 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f79edbf-a415-48cb-879c-916f9917c397 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:35.946083 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f79edbf-a415-48cb-879c-916f9917c397 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:35.946742 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8f79edbf-a415-48cb-879c-916f9917c397 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:36.068998 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c18a7608-fe2d-4f61-a0b4-2455d3fe9137 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:36.069631 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c18a7608-fe2d-4f61-a0b4-2455d3fe9137 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:36.077261 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c18a7608-fe2d-4f61-a0b4-2455d3fe9137 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:36.077723 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c18a7608-fe2d-4f61-a0b4-2455d3fe9137 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:36.078562 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c18a7608-fe2d-4f61-a0b4-2455d3fe9137 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:36.079118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c18a7608-fe2d-4f61-a0b4-2455d3fe9137 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:36.181449 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8f79edbf-a415-48cb-879c-916f9917c397 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:36.197691 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8f79edbf-a415-48cb-879c-916f9917c397 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.267896 Jun 16 16:12:36.199542 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 40/69] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:35 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:36.236701 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-eec3783e-49ed-4585-bcc2-d3e837eb0cae tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:36.243548 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-eec3783e-49ed-4585-bcc2-d3e837eb0cae tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:36.246962 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eec3783e-49ed-4585-bcc2-d3e837eb0cae tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:36.247761 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eec3783e-49ed-4585-bcc2-d3e837eb0cae tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:36.248281 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eec3783e-49ed-4585-bcc2-d3e837eb0cae tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:36.248721 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eec3783e-49ed-4585-bcc2-d3e837eb0cae tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:36.268742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c18a7608-fe2d-4f61-a0b4-2455d3fe9137 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:36.278575 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c18a7608-fe2d-4f61-a0b4-2455d3fe9137 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.212983 Jun 16 16:12:36.279184 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 30/70] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:36 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:36.434959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-904f830c-17d3-42ac-a6ee-3939eb6ab1a4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:36.435595 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-904f830c-17d3-42ac-a6ee-3939eb6ab1a4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:36.441504 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-eec3783e-49ed-4585-bcc2-d3e837eb0cae tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:36.442524 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-904f830c-17d3-42ac-a6ee-3939eb6ab1a4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:36.442978 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-904f830c-17d3-42ac-a6ee-3939eb6ab1a4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:36.443819 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-904f830c-17d3-42ac-a6ee-3939eb6ab1a4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:36.444455 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-904f830c-17d3-42ac-a6ee-3939eb6ab1a4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:36.450328 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-eec3783e-49ed-4585-bcc2-d3e837eb0cae tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.220487 Jun 16 16:12:36.451127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 41/71] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:36 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:36.620744 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-904f830c-17d3-42ac-a6ee-3939eb6ab1a4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:36.630188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-904f830c-17d3-42ac-a6ee-3939eb6ab1a4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.203080 Jun 16 16:12:36.630786 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 31/72] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:36 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:37.218523 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3e39588a-d0c8-43d8-ad04-bab76cdf87e8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:37.219166 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3e39588a-d0c8-43d8-ad04-bab76cdf87e8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:37.226606 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e39588a-d0c8-43d8-ad04-bab76cdf87e8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:37.226975 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e39588a-d0c8-43d8-ad04-bab76cdf87e8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:37.227874 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e39588a-d0c8-43d8-ad04-bab76cdf87e8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:37.228227 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e39588a-d0c8-43d8-ad04-bab76cdf87e8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:37.301207 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f8617e2b-bf02-47a3-a26a-7959020809d1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:37.302239 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f8617e2b-bf02-47a3-a26a-7959020809d1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:37.311821 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f8617e2b-bf02-47a3-a26a-7959020809d1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:37.312274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f8617e2b-bf02-47a3-a26a-7959020809d1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:37.313471 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f8617e2b-bf02-47a3-a26a-7959020809d1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:37.313943 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f8617e2b-bf02-47a3-a26a-7959020809d1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:37.410421 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3e39588a-d0c8-43d8-ad04-bab76cdf87e8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:37.419442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3e39588a-d0c8-43d8-ad04-bab76cdf87e8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.205576 Jun 16 16:12:37.420010 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 42/73] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:37 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:37.470952 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7b79252e-c28b-4578-a8d9-3dbdafbb0263 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:37.471848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7b79252e-c28b-4578-a8d9-3dbdafbb0263 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:37.479023 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b79252e-c28b-4578-a8d9-3dbdafbb0263 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:37.480035 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b79252e-c28b-4578-a8d9-3dbdafbb0263 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:37.481968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b79252e-c28b-4578-a8d9-3dbdafbb0263 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:37.482855 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b79252e-c28b-4578-a8d9-3dbdafbb0263 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:37.483495 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f8617e2b-bf02-47a3-a26a-7959020809d1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:37.495307 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f8617e2b-bf02-47a3-a26a-7959020809d1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.200616 Jun 16 16:12:37.505560 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 32/74] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:37 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:37.652381 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a1f03c00-c0cb-4eb5-9ca2-519f118f6a84 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:37.653514 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a1f03c00-c0cb-4eb5-9ca2-519f118f6a84 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:37.663879 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a1f03c00-c0cb-4eb5-9ca2-519f118f6a84 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:37.664587 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a1f03c00-c0cb-4eb5-9ca2-519f118f6a84 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:37.666183 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a1f03c00-c0cb-4eb5-9ca2-519f118f6a84 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:37.667146 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a1f03c00-c0cb-4eb5-9ca2-519f118f6a84 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:37.676311 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7b79252e-c28b-4578-a8d9-3dbdafbb0263 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:37.690820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7b79252e-c28b-4578-a8d9-3dbdafbb0263 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.223186 Jun 16 16:12:37.691758 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 43/75] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:37 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:37.889470 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a1f03c00-c0cb-4eb5-9ca2-519f118f6a84 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:37.900541 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a1f03c00-c0cb-4eb5-9ca2-519f118f6a84 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.256045 Jun 16 16:12:37.901133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 33/76] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:37 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:38.439358 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-95c3330b-026c-49e9-b1ff-ba4a0a99f468 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:38.440199 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-95c3330b-026c-49e9-b1ff-ba4a0a99f468 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:38.455319 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95c3330b-026c-49e9-b1ff-ba4a0a99f468 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:38.460534 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95c3330b-026c-49e9-b1ff-ba4a0a99f468 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:38.462241 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95c3330b-026c-49e9-b1ff-ba4a0a99f468 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:38.466855 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-95c3330b-026c-49e9-b1ff-ba4a0a99f468 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:38.519003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-606084cc-5234-4646-819b-3c3fb682eedd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:38.519994 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-606084cc-5234-4646-819b-3c3fb682eedd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:38.546171 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-606084cc-5234-4646-819b-3c3fb682eedd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:38.546966 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-606084cc-5234-4646-819b-3c3fb682eedd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:38.553103 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-606084cc-5234-4646-819b-3c3fb682eedd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:38.557363 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-606084cc-5234-4646-819b-3c3fb682eedd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:38.847804 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-95c3330b-026c-49e9-b1ff-ba4a0a99f468 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:38.857150 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-95c3330b-026c-49e9-b1ff-ba4a0a99f468 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.423101 Jun 16 16:12:38.867652 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 44/77] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:38 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:38.876615 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6e5c671e-abcb-4151-9da4-fd611b1e2fef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:38.877999 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6e5c671e-abcb-4151-9da4-fd611b1e2fef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:38.886378 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6e5c671e-abcb-4151-9da4-fd611b1e2fef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:38.888032 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6e5c671e-abcb-4151-9da4-fd611b1e2fef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:38.889523 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6e5c671e-abcb-4151-9da4-fd611b1e2fef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:38.890275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6e5c671e-abcb-4151-9da4-fd611b1e2fef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:39.111835 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-606084cc-5234-4646-819b-3c3fb682eedd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:39.136877 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-606084cc-5234-4646-819b-3c3fb682eedd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.626915 Jun 16 16:12:39.138211 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 34/78] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:38 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:39.154586 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fb84224c-9352-4d41-897e-6e3183207cc6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:39.155215 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-fb84224c-9352-4d41-897e-6e3183207cc6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:39.169589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fb84224c-9352-4d41-897e-6e3183207cc6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:39.173903 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fb84224c-9352-4d41-897e-6e3183207cc6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:39.179540 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fb84224c-9352-4d41-897e-6e3183207cc6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:39.180280 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fb84224c-9352-4d41-897e-6e3183207cc6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:39.469823 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6e5c671e-abcb-4151-9da4-fd611b1e2fef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:39.523668 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6e5c671e-abcb-4151-9da4-fd611b1e2fef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.653604 Jun 16 16:12:39.528474 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 45/79] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:38 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:39.557660 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-ecc6ff07-2104-44b7-b706-a47f5db1913d req-bdfe8430-cb69-41b3-b65b-57599ee64268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179d422e-be19-4c93-ad79-136aeb12c79a", "name": "network-vif-plugged", "status": "completed", "tag": "c019be23-ca59-4fbc-9e0d-aaca2c69887b"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:39.604710 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-ecc6ff07-2104-44b7-b706-a47f5db1913d req-bdfe8430-cb69-41b3-b65b-57599ee64268 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:39.605176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-ecc6ff07-2104-44b7-b706-a47f5db1913d req-bdfe8430-cb69-41b3-b65b-57599ee64268 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:39.705080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-ecc6ff07-2104-44b7-b706-a47f5db1913d req-bdfe8430-cb69-41b3-b65b-57599ee64268 service nova] Creating event network-vif-plugged:c019be23-ca59-4fbc-9e0d-aaca2c69887b for instance 179d422e-be19-4c93-ad79-136aeb12c79a on hv-cinder-83716 Jun 16 16:12:39.736256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-ecc6ff07-2104-44b7-b706-a47f5db1913d req-bdfe8430-cb69-41b3-b65b-57599ee64268 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205332 Jun 16 16:12:39.741066 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 46/80] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:12:39.878726 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ea41ed67-d00e-4e2b-8dd8-7cb345f81500 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:39.880840 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ea41ed67-d00e-4e2b-8dd8-7cb345f81500 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:39.914241 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ea41ed67-d00e-4e2b-8dd8-7cb345f81500 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:39.915033 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ea41ed67-d00e-4e2b-8dd8-7cb345f81500 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:39.921106 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fb84224c-9352-4d41-897e-6e3183207cc6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:39.922782 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ea41ed67-d00e-4e2b-8dd8-7cb345f81500 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:39.923886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ea41ed67-d00e-4e2b-8dd8-7cb345f81500 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:39.948126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fb84224c-9352-4d41-897e-6e3183207cc6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.808670 Jun 16 16:12:39.948883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 35/81] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:39 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:40.122970 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-43121953-a0fa-4f76-a1e4-e7618621d368 req-a0e5e3fa-c47e-493d-8a19-21800c6b372c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e263395e-8f5e-4b76-85de-41bf42f947ae", "tag": "bef1a992-09d2-465a-ab42-4a79a9fd1971"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:40.135279 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-43121953-a0fa-4f76-a1e4-e7618621d368 req-a0e5e3fa-c47e-493d-8a19-21800c6b372c service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:40.135982 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-43121953-a0fa-4f76-a1e4-e7618621d368 req-a0e5e3fa-c47e-493d-8a19-21800c6b372c service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:40.158031 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-43121953-a0fa-4f76-a1e4-e7618621d368 req-a0e5e3fa-c47e-493d-8a19-21800c6b372c service nova] Creating event network-changed:bef1a992-09d2-465a-ab42-4a79a9fd1971 for instance e263395e-8f5e-4b76-85de-41bf42f947ae on hv-cinder-83716 Jun 16 16:12:40.166351 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-43121953-a0fa-4f76-a1e4-e7618621d368 req-a0e5e3fa-c47e-493d-8a19-21800c6b372c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051107 Jun 16 16:12:40.167513 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 36/82] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:12:40.176119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f762c501-a2a3-4d7e-807d-0629ad03338d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:40.181810 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f762c501-a2a3-4d7e-807d-0629ad03338d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:40.197962 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f762c501-a2a3-4d7e-807d-0629ad03338d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:40.198437 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f762c501-a2a3-4d7e-807d-0629ad03338d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:40.203088 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f762c501-a2a3-4d7e-807d-0629ad03338d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:40.203562 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f762c501-a2a3-4d7e-807d-0629ad03338d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:40.296408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ea41ed67-d00e-4e2b-8dd8-7cb345f81500 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:40.307177 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ea41ed67-d00e-4e2b-8dd8-7cb345f81500 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.434992 Jun 16 16:12:40.307965 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 47/83] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:39 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:40.342127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-a3e5438f-e9a9-43d0-be3b-7115e91be14e req-89bb9ae1-6572-43a6-aca1-0fe25cd2f235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b69f513-c146-469b-9045-a974844f18cb", "tag": "b45f5873-c9a8-45d9-883c-9f0d81681036"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:40.355839 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-a3e5438f-e9a9-43d0-be3b-7115e91be14e req-89bb9ae1-6572-43a6-aca1-0fe25cd2f235 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:40.356999 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-a3e5438f-e9a9-43d0-be3b-7115e91be14e req-89bb9ae1-6572-43a6-aca1-0fe25cd2f235 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:40.379268 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-a3e5438f-e9a9-43d0-be3b-7115e91be14e req-89bb9ae1-6572-43a6-aca1-0fe25cd2f235 service nova] Creating event network-changed:b45f5873-c9a8-45d9-883c-9f0d81681036 for instance 6b69f513-c146-469b-9045-a974844f18cb on hv-cinder-83716 Jun 16 16:12:40.388545 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-a3e5438f-e9a9-43d0-be3b-7115e91be14e req-89bb9ae1-6572-43a6-aca1-0fe25cd2f235 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061008 Jun 16 16:12:40.389091 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 48/84] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:12:40.450108 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f762c501-a2a3-4d7e-807d-0629ad03338d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:40.487768 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f762c501-a2a3-4d7e-807d-0629ad03338d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.317563 Jun 16 16:12:40.488380 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 37/85] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:40 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:40.552334 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0d18738e-3214-48cf-8d1f-036fd6ec5b41 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:40.553118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0d18738e-3214-48cf-8d1f-036fd6ec5b41 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:40.562775 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0d18738e-3214-48cf-8d1f-036fd6ec5b41 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:40.563510 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0d18738e-3214-48cf-8d1f-036fd6ec5b41 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:40.564677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0d18738e-3214-48cf-8d1f-036fd6ec5b41 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:40.565360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0d18738e-3214-48cf-8d1f-036fd6ec5b41 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:40.939656 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0d18738e-3214-48cf-8d1f-036fd6ec5b41 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:40.950484 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0d18738e-3214-48cf-8d1f-036fd6ec5b41 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.402036 Jun 16 16:12:40.960065 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 49/86] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:40 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:40.974151 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1c3a735e-d3d8-4044-865f-67b286225afb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:40.975354 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1c3a735e-d3d8-4044-865f-67b286225afb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:40.983753 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1c3a735e-d3d8-4044-865f-67b286225afb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:40.985686 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1c3a735e-d3d8-4044-865f-67b286225afb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:40.986947 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1c3a735e-d3d8-4044-865f-67b286225afb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:40.991455 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1c3a735e-d3d8-4044-865f-67b286225afb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:41.330205 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b6c8ab85-444d-45e1-bca9-1e4782e4abb8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:41.331840 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1c3a735e-d3d8-4044-865f-67b286225afb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:41.337240 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b6c8ab85-444d-45e1-bca9-1e4782e4abb8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:41.356295 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1c3a735e-d3d8-4044-865f-67b286225afb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.387927 Jun 16 16:12:41.357586 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6c8ab85-444d-45e1-bca9-1e4782e4abb8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:41.372017 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 38/87] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:40 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:41.373732 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6c8ab85-444d-45e1-bca9-1e4782e4abb8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:41.380152 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6c8ab85-444d-45e1-bca9-1e4782e4abb8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:41.380897 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6c8ab85-444d-45e1-bca9-1e4782e4abb8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:41.517409 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-45ac0e71-3c05-4a2e-8964-cc84e5dc93e1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:41.524844 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-45ac0e71-3c05-4a2e-8964-cc84e5dc93e1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:41.540760 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-45ac0e71-3c05-4a2e-8964-cc84e5dc93e1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:41.543592 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-45ac0e71-3c05-4a2e-8964-cc84e5dc93e1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:41.545651 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-45ac0e71-3c05-4a2e-8964-cc84e5dc93e1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:41.546499 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-45ac0e71-3c05-4a2e-8964-cc84e5dc93e1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:41.994447 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b6c8ab85-444d-45e1-bca9-1e4782e4abb8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:42.014018 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b6c8ab85-444d-45e1-bca9-1e4782e4abb8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.679539 Jun 16 16:12:42.024453 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 50/88] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:41 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:42.024453 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3bd2133c-e2d5-4688-91d2-c475201b9bc1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:42.024453 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3bd2133c-e2d5-4688-91d2-c475201b9bc1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:42.033187 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3bd2133c-e2d5-4688-91d2-c475201b9bc1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:42.033742 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3bd2133c-e2d5-4688-91d2-c475201b9bc1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:42.034681 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3bd2133c-e2d5-4688-91d2-c475201b9bc1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:42.035367 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3bd2133c-e2d5-4688-91d2-c475201b9bc1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:42.068083 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-45ac0e71-3c05-4a2e-8964-cc84e5dc93e1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:42.087131 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-45ac0e71-3c05-4a2e-8964-cc84e5dc93e1 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.576853 Jun 16 16:12:42.092103 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 39/89] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:41 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:42.271929 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3bd2133c-e2d5-4688-91d2-c475201b9bc1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:42.288967 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3bd2133c-e2d5-4688-91d2-c475201b9bc1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.271594 Jun 16 16:12:42.290235 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 51/90] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:42 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:42.379427 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a4338a03-7d3e-4a54-be0f-6ad32a9ba51e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:42.380305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a4338a03-7d3e-4a54-be0f-6ad32a9ba51e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:42.387613 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a4338a03-7d3e-4a54-be0f-6ad32a9ba51e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:42.388727 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a4338a03-7d3e-4a54-be0f-6ad32a9ba51e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:42.389051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a4338a03-7d3e-4a54-be0f-6ad32a9ba51e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:42.389389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a4338a03-7d3e-4a54-be0f-6ad32a9ba51e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:42.575914 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a4338a03-7d3e-4a54-be0f-6ad32a9ba51e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:42.587995 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a4338a03-7d3e-4a54-be0f-6ad32a9ba51e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.212470 Jun 16 16:12:42.588900 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 40/91] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:42 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:43.037724 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e5feb81e-ff81-491e-9db9-db93624a3490 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:43.038538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e5feb81e-ff81-491e-9db9-db93624a3490 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:43.050972 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5feb81e-ff81-491e-9db9-db93624a3490 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:43.051727 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5feb81e-ff81-491e-9db9-db93624a3490 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:43.053056 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5feb81e-ff81-491e-9db9-db93624a3490 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:43.053749 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5feb81e-ff81-491e-9db9-db93624a3490 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:43.126036 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-aa648536-aff4-4073-a0c9-47a5f8866556 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:43.127188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-aa648536-aff4-4073-a0c9-47a5f8866556 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:43.141776 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aa648536-aff4-4073-a0c9-47a5f8866556 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:43.142910 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aa648536-aff4-4073-a0c9-47a5f8866556 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:43.144113 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aa648536-aff4-4073-a0c9-47a5f8866556 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:43.144791 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aa648536-aff4-4073-a0c9-47a5f8866556 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:43.167619 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=100 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:43.286497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e5feb81e-ff81-491e-9db9-db93624a3490 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:43.300747 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e5feb81e-ff81-491e-9db9-db93624a3490 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.271583 Jun 16 16:12:43.301455 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 52/92] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:43 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:43.323619 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-694cdb1b-f65e-42cb-8bd0-2664035513db tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:43.324651 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-694cdb1b-f65e-42cb-8bd0-2664035513db tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:43.325096 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-aa648536-aff4-4073-a0c9-47a5f8866556 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:43.336478 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-694cdb1b-f65e-42cb-8bd0-2664035513db tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:43.336751 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-aa648536-aff4-4073-a0c9-47a5f8866556 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.219230 Jun 16 16:12:43.337196 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-694cdb1b-f65e-42cb-8bd0-2664035513db tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:43.337367 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 41/93] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:43 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:43.354336 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-694cdb1b-f65e-42cb-8bd0-2664035513db tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:43.355092 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-694cdb1b-f65e-42cb-8bd0-2664035513db tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:43.565843 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-694cdb1b-f65e-42cb-8bd0-2664035513db tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:43.575869 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-694cdb1b-f65e-42cb-8bd0-2664035513db tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.258207 Jun 16 16:12:43.577298 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 53/94] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:43 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:43.613502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-82f5fc85-ab4c-4225-b050-1608bdadd98f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:43.614307 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-82f5fc85-ab4c-4225-b050-1608bdadd98f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:43.623409 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-82f5fc85-ab4c-4225-b050-1608bdadd98f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:43.624121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-82f5fc85-ab4c-4225-b050-1608bdadd98f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:43.625477 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-82f5fc85-ab4c-4225-b050-1608bdadd98f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:43.626428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-82f5fc85-ab4c-4225-b050-1608bdadd98f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:43.825711 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-82f5fc85-ab4c-4225-b050-1608bdadd98f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:43.834728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-82f5fc85-ab4c-4225-b050-1608bdadd98f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.226169 Jun 16 16:12:43.835324 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 42/95] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:43 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:44.323156 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-823c15bb-119e-45ec-ad90-f5177f041424 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:44.323938 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-823c15bb-119e-45ec-ad90-f5177f041424 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:44.330579 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-823c15bb-119e-45ec-ad90-f5177f041424 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:44.331062 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-823c15bb-119e-45ec-ad90-f5177f041424 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:44.331783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-823c15bb-119e-45ec-ad90-f5177f041424 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:44.332300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-823c15bb-119e-45ec-ad90-f5177f041424 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:44.360574 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-338db3b7-8ca6-4c96-b968-e5af344ffd5c tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:44.361772 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-338db3b7-8ca6-4c96-b968-e5af344ffd5c tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:44.368900 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-338db3b7-8ca6-4c96-b968-e5af344ffd5c tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:44.369617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-338db3b7-8ca6-4c96-b968-e5af344ffd5c tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:44.370595 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-338db3b7-8ca6-4c96-b968-e5af344ffd5c tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:44.371822 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-338db3b7-8ca6-4c96-b968-e5af344ffd5c tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:44.578918 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-338db3b7-8ca6-4c96-b968-e5af344ffd5c tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:44.587456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-823c15bb-119e-45ec-ad90-f5177f041424 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:44.589261 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-338db3b7-8ca6-4c96-b968-e5af344ffd5c tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.232365 Jun 16 16:12:44.590431 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 43/96] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:44 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:44.600174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b36c8522-2745-46fd-8df0-94986306bdf7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:44.601157 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b36c8522-2745-46fd-8df0-94986306bdf7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:44.611816 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-823c15bb-119e-45ec-ad90-f5177f041424 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.292195 Jun 16 16:12:44.613751 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b36c8522-2745-46fd-8df0-94986306bdf7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:44.614389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b36c8522-2745-46fd-8df0-94986306bdf7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:44.614732 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 54/97] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:44 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:44.615460 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b36c8522-2745-46fd-8df0-94986306bdf7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:44.615906 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b36c8522-2745-46fd-8df0-94986306bdf7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:44.811247 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b36c8522-2745-46fd-8df0-94986306bdf7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:44.822302 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b36c8522-2745-46fd-8df0-94986306bdf7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.226429 Jun 16 16:12:44.823042 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 44/98] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:44 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:44.865812 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-337be070-b917-44d9-8e89-cd5eb6140ea4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:44.866812 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-337be070-b917-44d9-8e89-cd5eb6140ea4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:44.878411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-337be070-b917-44d9-8e89-cd5eb6140ea4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:44.880389 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-337be070-b917-44d9-8e89-cd5eb6140ea4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:44.881584 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-337be070-b917-44d9-8e89-cd5eb6140ea4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:44.882090 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-337be070-b917-44d9-8e89-cd5eb6140ea4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:45.099916 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-337be070-b917-44d9-8e89-cd5eb6140ea4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:45.113720 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-337be070-b917-44d9-8e89-cd5eb6140ea4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.253886 Jun 16 16:12:45.114618 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 55/99] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:44 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:45.615194 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3f1b3c70-a253-4221-80f5-727a7b8fdeed tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:45.616048 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3f1b3c70-a253-4221-80f5-727a7b8fdeed tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:45.622943 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3f1b3c70-a253-4221-80f5-727a7b8fdeed tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:45.623628 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3f1b3c70-a253-4221-80f5-727a7b8fdeed tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:45.624600 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3f1b3c70-a253-4221-80f5-727a7b8fdeed tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:45.626146 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3f1b3c70-a253-4221-80f5-727a7b8fdeed tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:45.636252 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a10acafe-b1e8-4118-939d-583b76b20c77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:45.638640 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a10acafe-b1e8-4118-939d-583b76b20c77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:45.645985 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a10acafe-b1e8-4118-939d-583b76b20c77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:45.646872 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a10acafe-b1e8-4118-939d-583b76b20c77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:45.647871 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a10acafe-b1e8-4118-939d-583b76b20c77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:45.648626 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a10acafe-b1e8-4118-939d-583b76b20c77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:45.834783 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3f1b3c70-a253-4221-80f5-727a7b8fdeed tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:45.851735 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3f1b3c70-a253-4221-80f5-727a7b8fdeed tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.240271 Jun 16 16:12:45.852493 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 45/100] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:45 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:45.859906 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a9a21f93-14bd-4878-ba30-006dd455927f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:45.860856 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a9a21f93-14bd-4878-ba30-006dd455927f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:45.868164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a9a21f93-14bd-4878-ba30-006dd455927f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:45.868942 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a9a21f93-14bd-4878-ba30-006dd455927f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:45.869720 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a9a21f93-14bd-4878-ba30-006dd455927f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:45.870194 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a9a21f93-14bd-4878-ba30-006dd455927f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:45.906101 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a10acafe-b1e8-4118-939d-583b76b20c77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:45.914980 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a10acafe-b1e8-4118-939d-583b76b20c77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.283608 Jun 16 16:12:45.930246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 56/101] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:45 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:46.044762 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a9a21f93-14bd-4878-ba30-006dd455927f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:46.053185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a9a21f93-14bd-4878-ba30-006dd455927f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.198723 Jun 16 16:12:46.053857 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 46/102] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:45 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:46.138737 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2752449b-4989-4a79-b84d-a5d7d1f6d98c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:46.139538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2752449b-4989-4a79-b84d-a5d7d1f6d98c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:46.146111 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2752449b-4989-4a79-b84d-a5d7d1f6d98c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:46.146571 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2752449b-4989-4a79-b84d-a5d7d1f6d98c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:46.147358 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2752449b-4989-4a79-b84d-a5d7d1f6d98c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:46.147793 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2752449b-4989-4a79-b84d-a5d7d1f6d98c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:46.152269 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=100 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:46.296663 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2752449b-4989-4a79-b84d-a5d7d1f6d98c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:46.305694 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2752449b-4989-4a79-b84d-a5d7d1f6d98c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.170914 Jun 16 16:12:46.306329 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 57/103] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:46 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:46.870073 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4ee94991-c479-49e9-81ed-7de2ab174136 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:46.870692 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4ee94991-c479-49e9-81ed-7de2ab174136 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:46.877407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4ee94991-c479-49e9-81ed-7de2ab174136 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:46.877872 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4ee94991-c479-49e9-81ed-7de2ab174136 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:46.878659 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4ee94991-c479-49e9-81ed-7de2ab174136 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:46.879109 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4ee94991-c479-49e9-81ed-7de2ab174136 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:46.940613 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-453880ab-00e9-4b98-af3b-582a3194323f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:46.941442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-453880ab-00e9-4b98-af3b-582a3194323f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:46.948195 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-453880ab-00e9-4b98-af3b-582a3194323f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:46.948647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-453880ab-00e9-4b98-af3b-582a3194323f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:46.949804 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-453880ab-00e9-4b98-af3b-582a3194323f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:46.950342 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-453880ab-00e9-4b98-af3b-582a3194323f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:47.030793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4ee94991-c479-49e9-81ed-7de2ab174136 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:47.040884 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4ee94991-c479-49e9-81ed-7de2ab174136 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.174594 Jun 16 16:12:47.041491 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 47/104] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:46 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:47.074271 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-13b4be4b-089d-42fb-8f83-eea7d249dd12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:47.075362 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-13b4be4b-089d-42fb-8f83-eea7d249dd12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:47.082911 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-13b4be4b-089d-42fb-8f83-eea7d249dd12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:47.083367 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-13b4be4b-089d-42fb-8f83-eea7d249dd12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:47.084165 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-13b4be4b-089d-42fb-8f83-eea7d249dd12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:47.084725 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-13b4be4b-089d-42fb-8f83-eea7d249dd12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:47.121285 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-453880ab-00e9-4b98-af3b-582a3194323f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:47.131146 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-453880ab-00e9-4b98-af3b-582a3194323f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.194270 Jun 16 16:12:47.132104 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 58/105] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:46 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:47.237439 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-13b4be4b-089d-42fb-8f83-eea7d249dd12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:47.246248 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-13b4be4b-089d-42fb-8f83-eea7d249dd12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.176764 Jun 16 16:12:47.247185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 48/106] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:47 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:47.327732 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1fd084a1-14f0-4be3-9a6d-3475e24e7308 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:47.328744 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1fd084a1-14f0-4be3-9a6d-3475e24e7308 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:47.338546 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1fd084a1-14f0-4be3-9a6d-3475e24e7308 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:47.339281 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1fd084a1-14f0-4be3-9a6d-3475e24e7308 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:47.341130 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1fd084a1-14f0-4be3-9a6d-3475e24e7308 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:47.341821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1fd084a1-14f0-4be3-9a6d-3475e24e7308 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:47.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1fd084a1-14f0-4be3-9a6d-3475e24e7308 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:47.526302 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1fd084a1-14f0-4be3-9a6d-3475e24e7308 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.205444 Jun 16 16:12:47.527082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 59/107] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:47 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:48.061212 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-288548a6-584c-45e8-84f8-cd70bcd067df tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:48.061834 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-288548a6-584c-45e8-84f8-cd70bcd067df tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:48.068687 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-288548a6-584c-45e8-84f8-cd70bcd067df tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:48.069175 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-288548a6-584c-45e8-84f8-cd70bcd067df tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:48.070007 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-288548a6-584c-45e8-84f8-cd70bcd067df tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:48.070469 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-288548a6-584c-45e8-84f8-cd70bcd067df tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:48.149582 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4efee096-128e-4654-9f83-a3df7057975a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:48.150246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4efee096-128e-4654-9f83-a3df7057975a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:48.156941 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4efee096-128e-4654-9f83-a3df7057975a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:48.157435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4efee096-128e-4654-9f83-a3df7057975a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:48.158293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4efee096-128e-4654-9f83-a3df7057975a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:48.158745 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4efee096-128e-4654-9f83-a3df7057975a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:48.249408 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-288548a6-584c-45e8-84f8-cd70bcd067df tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:48.258874 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-288548a6-584c-45e8-84f8-cd70bcd067df tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.202081 Jun 16 16:12:48.259570 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 49/108] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:48 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:48.265504 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a10307be-8669-4395-a7e3-1e69fcdcde73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:48.266267 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a10307be-8669-4395-a7e3-1e69fcdcde73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:48.272753 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a10307be-8669-4395-a7e3-1e69fcdcde73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:48.273335 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a10307be-8669-4395-a7e3-1e69fcdcde73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:48.274477 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a10307be-8669-4395-a7e3-1e69fcdcde73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:48.274930 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a10307be-8669-4395-a7e3-1e69fcdcde73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:48.322410 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4efee096-128e-4654-9f83-a3df7057975a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:48.331934 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4efee096-128e-4654-9f83-a3df7057975a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.186334 Jun 16 16:12:48.332597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 60/109] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:48 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:48.420280 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a10307be-8669-4395-a7e3-1e69fcdcde73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:48.427940 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a10307be-8669-4395-a7e3-1e69fcdcde73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.166796 Jun 16 16:12:48.428524 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 50/110] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:48 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:48.547900 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-71c10966-e090-4134-948d-27a13e0eb75d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:48.547900 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-71c10966-e090-4134-948d-27a13e0eb75d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:48.555039 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-71c10966-e090-4134-948d-27a13e0eb75d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:48.555039 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-71c10966-e090-4134-948d-27a13e0eb75d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:48.564350 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-71c10966-e090-4134-948d-27a13e0eb75d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:48.564350 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-71c10966-e090-4134-948d-27a13e0eb75d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:48.758554 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-71c10966-e090-4134-948d-27a13e0eb75d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:48.768316 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-71c10966-e090-4134-948d-27a13e0eb75d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.228463 Jun 16 16:12:48.768913 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 61/111] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:48 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:48.986778 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-dec50c22-321b-43f8-a41f-d444709c8b94 req-bf38b40f-f0d8-4c0e-9e8d-53f571669f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5", "name": "network-vif-plugged", "status": "completed", "tag": "ecd1c4fc-716d-40aa-81c3-83ee9f284517"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:49.001632 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-dec50c22-321b-43f8-a41f-d444709c8b94 req-bf38b40f-f0d8-4c0e-9e8d-53f571669f8b service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:49.002541 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-dec50c22-321b-43f8-a41f-d444709c8b94 req-bf38b40f-f0d8-4c0e-9e8d-53f571669f8b service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:49.036438 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-dec50c22-321b-43f8-a41f-d444709c8b94 req-bf38b40f-f0d8-4c0e-9e8d-53f571669f8b service nova] Creating event network-vif-plugged:ecd1c4fc-716d-40aa-81c3-83ee9f284517 for instance fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 on hv-cinder-83716 Jun 16 16:12:49.046900 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-dec50c22-321b-43f8-a41f-d444709c8b94 req-bf38b40f-f0d8-4c0e-9e8d-53f571669f8b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067285 Jun 16 16:12:49.047885 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 51/112] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:12:49.286049 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-287fec1d-e361-413b-aa49-2c3fc53e648f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:49.288724 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-287fec1d-e361-413b-aa49-2c3fc53e648f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:49.296732 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-287fec1d-e361-413b-aa49-2c3fc53e648f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:49.297127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-287fec1d-e361-413b-aa49-2c3fc53e648f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:49.298261 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-287fec1d-e361-413b-aa49-2c3fc53e648f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:49.298638 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-287fec1d-e361-413b-aa49-2c3fc53e648f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:49.352348 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-865b2bd4-a3ce-4fe2-bd2e-3ab4cd5971bc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:49.354452 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-865b2bd4-a3ce-4fe2-bd2e-3ab4cd5971bc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:49.363655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-865b2bd4-a3ce-4fe2-bd2e-3ab4cd5971bc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:49.364242 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-865b2bd4-a3ce-4fe2-bd2e-3ab4cd5971bc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:49.365123 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-865b2bd4-a3ce-4fe2-bd2e-3ab4cd5971bc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:49.365770 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-865b2bd4-a3ce-4fe2-bd2e-3ab4cd5971bc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:49.619837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-865b2bd4-a3ce-4fe2-bd2e-3ab4cd5971bc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:49.638060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-865b2bd4-a3ce-4fe2-bd2e-3ab4cd5971bc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.291561 Jun 16 16:12:49.639126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 52/113] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:49 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:49.649521 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-dcb543dd-1129-4848-85e7-3ef7e61ce621 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:49.651203 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-dcb543dd-1129-4848-85e7-3ef7e61ce621 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:49.665743 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-287fec1d-e361-413b-aa49-2c3fc53e648f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:49.667651 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dcb543dd-1129-4848-85e7-3ef7e61ce621 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:49.679104 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dcb543dd-1129-4848-85e7-3ef7e61ce621 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:49.679104 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dcb543dd-1129-4848-85e7-3ef7e61ce621 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:49.679104 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dcb543dd-1129-4848-85e7-3ef7e61ce621 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:49.679312 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-287fec1d-e361-413b-aa49-2c3fc53e648f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1314 microversion: 2.1 time: 0.398488 Jun 16 16:12:49.679901 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 62/114] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:49 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:49.795372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9c5e940a-5d00-46ab-8aaf-aea7b64ad8b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:49.796691 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9c5e940a-5d00-46ab-8aaf-aea7b64ad8b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:49.812013 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9c5e940a-5d00-46ab-8aaf-aea7b64ad8b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:49.812891 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9c5e940a-5d00-46ab-8aaf-aea7b64ad8b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:49.814614 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9c5e940a-5d00-46ab-8aaf-aea7b64ad8b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:49.815351 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9c5e940a-5d00-46ab-8aaf-aea7b64ad8b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:49.928617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-dcb543dd-1129-4848-85e7-3ef7e61ce621 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:49.940450 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-dcb543dd-1129-4848-85e7-3ef7e61ce621 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.298090 Jun 16 16:12:49.941479 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 53/115] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:49 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:50.129947 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9c5e940a-5d00-46ab-8aaf-aea7b64ad8b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:50.142293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9c5e940a-5d00-46ab-8aaf-aea7b64ad8b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.357929 Jun 16 16:12:50.146337 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 63/116] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:49 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:50.669563 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6ae121c1-bd2b-4d23-b25e-1de9db4492bd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:50.670980 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6ae121c1-bd2b-4d23-b25e-1de9db4492bd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:50.682174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ae121c1-bd2b-4d23-b25e-1de9db4492bd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:50.682907 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ae121c1-bd2b-4d23-b25e-1de9db4492bd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:50.685502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ae121c1-bd2b-4d23-b25e-1de9db4492bd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:50.687974 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ae121c1-bd2b-4d23-b25e-1de9db4492bd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:50.720999 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-392591b6-c8b5-4f2b-9297-bb4a54b2c6f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:50.725624 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-392591b6-c8b5-4f2b-9297-bb4a54b2c6f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:50.749026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-392591b6-c8b5-4f2b-9297-bb4a54b2c6f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:50.750247 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-392591b6-c8b5-4f2b-9297-bb4a54b2c6f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:50.766508 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-392591b6-c8b5-4f2b-9297-bb4a54b2c6f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:50.769336 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-392591b6-c8b5-4f2b-9297-bb4a54b2c6f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:50.954096 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6ae121c1-bd2b-4d23-b25e-1de9db4492bd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:50.979951 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6ae121c1-bd2b-4d23-b25e-1de9db4492bd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.317906 Jun 16 16:12:51.000473 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 54/117] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:50 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:51.015647 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3e3e12a6-600e-402c-92cd-8e6588b14236 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:51.017624 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3e3e12a6-600e-402c-92cd-8e6588b14236 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:51.030979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3e3e12a6-600e-402c-92cd-8e6588b14236 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:51.031428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3e3e12a6-600e-402c-92cd-8e6588b14236 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:51.032535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3e3e12a6-600e-402c-92cd-8e6588b14236 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:51.033164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3e3e12a6-600e-402c-92cd-8e6588b14236 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:51.038048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-392591b6-c8b5-4f2b-9297-bb4a54b2c6f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:51.054139 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-392591b6-c8b5-4f2b-9297-bb4a54b2c6f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1500 microversion: 2.1 time: 0.351623 Jun 16 16:12:51.055017 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 64/118] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:50 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1500 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:51.165084 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3cfd69d1-4f64-49e2-b16c-44d78f82a6d2 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:51.166159 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3cfd69d1-4f64-49e2-b16c-44d78f82a6d2 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:51.174519 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3cfd69d1-4f64-49e2-b16c-44d78f82a6d2 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:51.175343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3cfd69d1-4f64-49e2-b16c-44d78f82a6d2 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:51.176457 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3cfd69d1-4f64-49e2-b16c-44d78f82a6d2 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:51.177069 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3cfd69d1-4f64-49e2-b16c-44d78f82a6d2 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:51.426005 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3cfd69d1-4f64-49e2-b16c-44d78f82a6d2 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:51.434178 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3cfd69d1-4f64-49e2-b16c-44d78f82a6d2 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.272966 Jun 16 16:12:51.438882 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 65/119] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:51 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:51.504136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3e3e12a6-600e-402c-92cd-8e6588b14236 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:51.520141 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3e3e12a6-600e-402c-92cd-8e6588b14236 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.516710 Jun 16 16:12:51.530781 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 55/120] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:51 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:52.013650 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-689fb5f4-f4cb-4627-b4dc-3b1050bd0b57 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:52.014833 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-689fb5f4-f4cb-4627-b4dc-3b1050bd0b57 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:52.025519 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-689fb5f4-f4cb-4627-b4dc-3b1050bd0b57 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:52.026335 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-689fb5f4-f4cb-4627-b4dc-3b1050bd0b57 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:52.028958 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-689fb5f4-f4cb-4627-b4dc-3b1050bd0b57 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:52.030055 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-689fb5f4-f4cb-4627-b4dc-3b1050bd0b57 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:52.435852 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-689fb5f4-f4cb-4627-b4dc-3b1050bd0b57 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:52.455888 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d5e4409f-b28a-4d32-b118-62f93ebada70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:52.457814 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d5e4409f-b28a-4d32-b118-62f93ebada70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:52.468969 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5e4409f-b28a-4d32-b118-62f93ebada70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:52.469680 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5e4409f-b28a-4d32-b118-62f93ebada70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:52.471792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5e4409f-b28a-4d32-b118-62f93ebada70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:52.472735 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5e4409f-b28a-4d32-b118-62f93ebada70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:52.475922 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-689fb5f4-f4cb-4627-b4dc-3b1050bd0b57 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.470422 Jun 16 16:12:52.476721 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 66/121] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:52 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:52.568065 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-983e78d9-aaca-4a35-905d-b4eb1a1a74c8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:52.568783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-983e78d9-aaca-4a35-905d-b4eb1a1a74c8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:52.599402 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-983e78d9-aaca-4a35-905d-b4eb1a1a74c8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:52.607810 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-983e78d9-aaca-4a35-905d-b4eb1a1a74c8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:52.611678 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-983e78d9-aaca-4a35-905d-b4eb1a1a74c8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:52.616549 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-983e78d9-aaca-4a35-905d-b4eb1a1a74c8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:52.741281 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d5e4409f-b28a-4d32-b118-62f93ebada70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:52.760115 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d5e4409f-b28a-4d32-b118-62f93ebada70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.311247 Jun 16 16:12:52.764643 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 56/122] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:52 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:52.816974 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4cc5fccb-df62-41fc-be3d-a1c7adad8f2d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f005070-5b52-4a14-8dc4-84b3f8dc1edc"}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:52.818174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4cc5fccb-df62-41fc-be3d-a1c7adad8f2d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:52.825267 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4cc5fccb-df62-41fc-be3d-a1c7adad8f2d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:52.828190 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4cc5fccb-df62-41fc-be3d-a1c7adad8f2d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:52.829242 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4cc5fccb-df62-41fc-be3d-a1c7adad8f2d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:52.829558 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4cc5fccb-df62-41fc-be3d-a1c7adad8f2d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:52.891395 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-983e78d9-aaca-4a35-905d-b4eb1a1a74c8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:52.900677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-983e78d9-aaca-4a35-905d-b4eb1a1a74c8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.357513 Jun 16 16:12:52.901900 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 67/123] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:52 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:53.496653 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a5f11867-1eaf-4e98-986b-76d92a21f1a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:53.497312 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a5f11867-1eaf-4e98-986b-76d92a21f1a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:53.500539 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=100 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:53.517294 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a5f11867-1eaf-4e98-986b-76d92a21f1a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:53.517822 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a5f11867-1eaf-4e98-986b-76d92a21f1a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:53.520538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a5f11867-1eaf-4e98-986b-76d92a21f1a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:53.521045 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a5f11867-1eaf-4e98-986b-76d92a21f1a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:53.717488 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a5f11867-1eaf-4e98-986b-76d92a21f1a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:53.729318 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a5f11867-1eaf-4e98-986b-76d92a21f1a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.237986 Jun 16 16:12:53.741291 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 68/124] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:53 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:53.785683 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7a75be76-2b3a-4335-80cf-7eae6ceb5499 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:53.787529 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7a75be76-2b3a-4335-80cf-7eae6ceb5499 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:53.799990 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a75be76-2b3a-4335-80cf-7eae6ceb5499 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:53.800697 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a75be76-2b3a-4335-80cf-7eae6ceb5499 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:53.801820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a75be76-2b3a-4335-80cf-7eae6ceb5499 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:53.802580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a75be76-2b3a-4335-80cf-7eae6ceb5499 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:53.980132 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7a75be76-2b3a-4335-80cf-7eae6ceb5499 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:53.990562 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7a75be76-2b3a-4335-80cf-7eae6ceb5499 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.211055 Jun 16 16:12:53.991155 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 69/125] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:53 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:53.997517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-76c9540a-c67e-4bc8-a8ec-604edadb5563 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:53.998679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-76c9540a-c67e-4bc8-a8ec-604edadb5563 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:54.012077 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-76c9540a-c67e-4bc8-a8ec-604edadb5563 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:54.012900 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-76c9540a-c67e-4bc8-a8ec-604edadb5563 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:54.014102 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-76c9540a-c67e-4bc8-a8ec-604edadb5563 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:54.014760 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-76c9540a-c67e-4bc8-a8ec-604edadb5563 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:54.195970 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-76c9540a-c67e-4bc8-a8ec-604edadb5563 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:54.210337 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-76c9540a-c67e-4bc8-a8ec-604edadb5563 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.217629 Jun 16 16:12:54.211419 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 70/126] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:53 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:54.749303 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b9cb3f89-ab6d-415c-b95d-d35e0f2cbf5e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:54.750031 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b9cb3f89-ab6d-415c-b95d-d35e0f2cbf5e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:54.762882 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9cb3f89-ab6d-415c-b95d-d35e0f2cbf5e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:54.763413 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9cb3f89-ab6d-415c-b95d-d35e0f2cbf5e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:54.764466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9cb3f89-ab6d-415c-b95d-d35e0f2cbf5e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:54.765213 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9cb3f89-ab6d-415c-b95d-d35e0f2cbf5e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:54.969392 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b9cb3f89-ab6d-415c-b95d-d35e0f2cbf5e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:54.985148 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b9cb3f89-ab6d-415c-b95d-d35e0f2cbf5e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.240151 Jun 16 16:12:54.998476 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 71/127] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:54 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:55.015873 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-59b6ee11-690c-4ed6-9ede-85bc34a66f38 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:55.016525 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-59b6ee11-690c-4ed6-9ede-85bc34a66f38 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:55.023301 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59b6ee11-690c-4ed6-9ede-85bc34a66f38 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:55.023750 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59b6ee11-690c-4ed6-9ede-85bc34a66f38 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:55.024518 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59b6ee11-690c-4ed6-9ede-85bc34a66f38 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:55.024953 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59b6ee11-690c-4ed6-9ede-85bc34a66f38 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:55.220177 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-59b6ee11-690c-4ed6-9ede-85bc34a66f38 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:55.233442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-59b6ee11-690c-4ed6-9ede-85bc34a66f38 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.221624 Jun 16 16:12:55.234455 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 72/128] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:55 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:55.243096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-344bbfd2-9944-4d75-b436-648329e2fa68 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:55.244436 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-344bbfd2-9944-4d75-b436-648329e2fa68 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:55.255578 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-344bbfd2-9944-4d75-b436-648329e2fa68 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:55.256739 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-344bbfd2-9944-4d75-b436-648329e2fa68 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:55.258321 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-344bbfd2-9944-4d75-b436-648329e2fa68 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:55.259089 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-344bbfd2-9944-4d75-b436-648329e2fa68 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:55.434408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-344bbfd2-9944-4d75-b436-648329e2fa68 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:55.438441 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=100 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:55.450341 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-344bbfd2-9944-4d75-b436-648329e2fa68 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.212954 Jun 16 16:12:55.451816 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 73/129] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:55 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:56.006568 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-36327c10-b3a8-46a4-86ca-abbc216659de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:56.007970 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-36327c10-b3a8-46a4-86ca-abbc216659de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:56.015456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-36327c10-b3a8-46a4-86ca-abbc216659de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:56.015910 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-36327c10-b3a8-46a4-86ca-abbc216659de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:56.016692 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-36327c10-b3a8-46a4-86ca-abbc216659de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:56.017243 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-36327c10-b3a8-46a4-86ca-abbc216659de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:56.231839 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-36327c10-b3a8-46a4-86ca-abbc216659de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:56.242730 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-36327c10-b3a8-46a4-86ca-abbc216659de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.240460 Jun 16 16:12:56.244271 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 74/130] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:56 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:56.255968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2f472784-e0a0-48a8-9a5a-9934ca8a8d48 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:56.256880 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2f472784-e0a0-48a8-9a5a-9934ca8a8d48 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:56.269826 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2f472784-e0a0-48a8-9a5a-9934ca8a8d48 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:56.269826 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2f472784-e0a0-48a8-9a5a-9934ca8a8d48 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:56.270568 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2f472784-e0a0-48a8-9a5a-9934ca8a8d48 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:56.271299 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2f472784-e0a0-48a8-9a5a-9934ca8a8d48 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:56.453436 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2f472784-e0a0-48a8-9a5a-9934ca8a8d48 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:56.461837 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2f472784-e0a0-48a8-9a5a-9934ca8a8d48 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.211171 Jun 16 16:12:56.462573 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 75/131] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:56 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:56.480943 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ae38a56a-6b9a-4cb0-88c5-f1dd7d5450cd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:56.481522 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ae38a56a-6b9a-4cb0-88c5-f1dd7d5450cd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:56.487801 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ae38a56a-6b9a-4cb0-88c5-f1dd7d5450cd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:56.488755 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ae38a56a-6b9a-4cb0-88c5-f1dd7d5450cd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:56.489552 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ae38a56a-6b9a-4cb0-88c5-f1dd7d5450cd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:56.490014 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ae38a56a-6b9a-4cb0-88c5-f1dd7d5450cd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:56.697179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ae38a56a-6b9a-4cb0-88c5-f1dd7d5450cd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:56.710511 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ae38a56a-6b9a-4cb0-88c5-f1dd7d5450cd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1322 microversion: 2.1 time: 0.237813 Jun 16 16:12:56.711102 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 76/132] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:56 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:57.272884 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0d10c3c8-b7c8-4209-85bf-4318e3ece0ed tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:57.276508 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0d10c3c8-b7c8-4209-85bf-4318e3ece0ed tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:57.295311 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0d10c3c8-b7c8-4209-85bf-4318e3ece0ed tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:57.297188 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0d10c3c8-b7c8-4209-85bf-4318e3ece0ed tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:57.298337 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0d10c3c8-b7c8-4209-85bf-4318e3ece0ed tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:57.300777 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0d10c3c8-b7c8-4209-85bf-4318e3ece0ed tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:57.714258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0d10c3c8-b7c8-4209-85bf-4318e3ece0ed tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:57.726228 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0d10c3c8-b7c8-4209-85bf-4318e3ece0ed tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.462682 Jun 16 16:12:57.727128 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 77/133] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:57 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:57.737343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fa8c0038-0ffd-49e4-9e9a-bf13ba790a18 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:57.738622 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fa8c0038-0ffd-49e4-9e9a-bf13ba790a18 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:57.751107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa8c0038-0ffd-49e4-9e9a-bf13ba790a18 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:57.751920 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa8c0038-0ffd-49e4-9e9a-bf13ba790a18 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:57.753052 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa8c0038-0ffd-49e4-9e9a-bf13ba790a18 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:57.754130 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa8c0038-0ffd-49e4-9e9a-bf13ba790a18 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:58.008670 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fa8c0038-0ffd-49e4-9e9a-bf13ba790a18 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:58.022144 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fa8c0038-0ffd-49e4-9e9a-bf13ba790a18 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.292916 Jun 16 16:12:58.023235 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 78/134] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:57 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:58.031661 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2ee85246-9560-4fe4-9ed6-b65da18cd26a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:58.033720 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2ee85246-9560-4fe4-9ed6-b65da18cd26a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:58.046050 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ee85246-9560-4fe4-9ed6-b65da18cd26a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:58.047378 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ee85246-9560-4fe4-9ed6-b65da18cd26a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:58.048609 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ee85246-9560-4fe4-9ed6-b65da18cd26a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:58.049467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ee85246-9560-4fe4-9ed6-b65da18cd26a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:58.288984 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2ee85246-9560-4fe4-9ed6-b65da18cd26a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:58.303382 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2ee85246-9560-4fe4-9ed6-b65da18cd26a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1516 microversion: 2.1 time: 0.277844 Jun 16 16:12:58.304428 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 79/135] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:58 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1516 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:58.332068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5ea3e669-fb4e-411b-85d3-38c0ef0a5a46 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:58.333384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5ea3e669-fb4e-411b-85d3-38c0ef0a5a46 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:58.341575 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5ea3e669-fb4e-411b-85d3-38c0ef0a5a46 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:58.342443 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5ea3e669-fb4e-411b-85d3-38c0ef0a5a46 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:58.344447 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5ea3e669-fb4e-411b-85d3-38c0ef0a5a46 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:58.347749 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5ea3e669-fb4e-411b-85d3-38c0ef0a5a46 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:58.439756 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-5ea3e669-fb4e-411b-85d3-38c0ef0a5a46 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lazy-loading 'flavor' on Instance uuid fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:12:58.603624 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5ea3e669-fb4e-411b-85d3-38c0ef0a5a46 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "POST /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5/action" status: 200 len: 32 microversion: 2.1 time: 0.277066 Jun 16 16:12:58.604426 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 80/136] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 16:12:58 2022] POST /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5/action => generated 32 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 16:12:58.618941 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a0274615-31c0-43e4-a57a-5c04bcbe2132 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:58.620609 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a0274615-31c0-43e4-a57a-5c04bcbe2132 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:58.633195 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a0274615-31c0-43e4-a57a-5c04bcbe2132 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:58.634076 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a0274615-31c0-43e4-a57a-5c04bcbe2132 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:58.635474 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a0274615-31c0-43e4-a57a-5c04bcbe2132 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:58.636412 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a0274615-31c0-43e4-a57a-5c04bcbe2132 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:58.863414 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a0274615-31c0-43e4-a57a-5c04bcbe2132 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:58.872918 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a0274615-31c0-43e4-a57a-5c04bcbe2132 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.260953 Jun 16 16:12:58.873501 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 81/137] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:58 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:58.878426 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4148d5f1-ec72-4b23-924b-dc3f632bc847 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:58.879238 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4148d5f1-ec72-4b23-924b-dc3f632bc847 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:58.885977 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4148d5f1-ec72-4b23-924b-dc3f632bc847 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:58.886498 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4148d5f1-ec72-4b23-924b-dc3f632bc847 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:58.887510 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4148d5f1-ec72-4b23-924b-dc3f632bc847 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:58.887945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4148d5f1-ec72-4b23-924b-dc3f632bc847 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:59.088497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4148d5f1-ec72-4b23-924b-dc3f632bc847 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:59.099121 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4148d5f1-ec72-4b23-924b-dc3f632bc847 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.223499 Jun 16 16:12:59.099121 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 82/138] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:58 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:59.103939 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8794f882-e06d-4f91-94bf-93d950d32c7c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:59.104792 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8794f882-e06d-4f91-94bf-93d950d32c7c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:59.114189 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8794f882-e06d-4f91-94bf-93d950d32c7c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:59.115647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8794f882-e06d-4f91-94bf-93d950d32c7c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:59.116842 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8794f882-e06d-4f91-94bf-93d950d32c7c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:59.117332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8794f882-e06d-4f91-94bf-93d950d32c7c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:59.375562 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8794f882-e06d-4f91-94bf-93d950d32c7c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:59.394464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8794f882-e06d-4f91-94bf-93d950d32c7c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.294037 Jun 16 16:12:59.395925 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 83/139] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:59 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:59.903335 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-77739893-f1d4-445f-b846-028bf08c1d00 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:59.904911 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-77739893-f1d4-445f-b846-028bf08c1d00 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:59.918095 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-77739893-f1d4-445f-b846-028bf08c1d00 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:59.918835 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-77739893-f1d4-445f-b846-028bf08c1d00 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:59.920259 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-77739893-f1d4-445f-b846-028bf08c1d00 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:59.921171 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-77739893-f1d4-445f-b846-028bf08c1d00 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:00.172428 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-77739893-f1d4-445f-b846-028bf08c1d00 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:00.183414 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-77739893-f1d4-445f-b846-028bf08c1d00 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.287403 Jun 16 16:13:00.184466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 84/140] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:59 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:00.191980 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-72c87ec4-7276-4874-9f4d-17033b90ef6e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:00.193369 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-72c87ec4-7276-4874-9f4d-17033b90ef6e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:00.205440 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-72c87ec4-7276-4874-9f4d-17033b90ef6e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:00.206381 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-72c87ec4-7276-4874-9f4d-17033b90ef6e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:00.207924 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-72c87ec4-7276-4874-9f4d-17033b90ef6e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:00.208648 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-72c87ec4-7276-4874-9f4d-17033b90ef6e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:00.412474 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-72c87ec4-7276-4874-9f4d-17033b90ef6e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:00.421842 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-72c87ec4-7276-4874-9f4d-17033b90ef6e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.235916 Jun 16 16:13:00.422598 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 85/141] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:00 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:00.427691 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8a939f04-4efc-42ce-80d1-cc24b8badf3b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:00.428305 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8a939f04-4efc-42ce-80d1-cc24b8badf3b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:00.436680 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a939f04-4efc-42ce-80d1-cc24b8badf3b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:00.437551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a939f04-4efc-42ce-80d1-cc24b8badf3b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:00.438669 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a939f04-4efc-42ce-80d1-cc24b8badf3b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:00.439124 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a939f04-4efc-42ce-80d1-cc24b8badf3b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:00.653678 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8a939f04-4efc-42ce-80d1-cc24b8badf3b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:00.663035 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8a939f04-4efc-42ce-80d1-cc24b8badf3b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.239229 Jun 16 16:13:00.663962 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 86/142] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:00 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:01.215786 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-02f6572a-4f53-4d31-b710-87f2f1d8ec2e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:01.217416 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-02f6572a-4f53-4d31-b710-87f2f1d8ec2e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:01.230389 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-02f6572a-4f53-4d31-b710-87f2f1d8ec2e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:01.231280 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-02f6572a-4f53-4d31-b710-87f2f1d8ec2e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:01.250519 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-02f6572a-4f53-4d31-b710-87f2f1d8ec2e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:01.252410 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-02f6572a-4f53-4d31-b710-87f2f1d8ec2e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:01.665986 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-02f6572a-4f53-4d31-b710-87f2f1d8ec2e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:01.707628 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-02f6572a-4f53-4d31-b710-87f2f1d8ec2e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.505760 Jun 16 16:13:01.711843 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 87/143] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:01 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:01.729848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d759be6f-6cc7-456d-9564-06bba5859b08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:01.730891 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d759be6f-6cc7-456d-9564-06bba5859b08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:01.744738 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d759be6f-6cc7-456d-9564-06bba5859b08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:01.745643 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d759be6f-6cc7-456d-9564-06bba5859b08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:01.746974 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d759be6f-6cc7-456d-9564-06bba5859b08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:01.747620 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d759be6f-6cc7-456d-9564-06bba5859b08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:01.789328 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:02.055919 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d759be6f-6cc7-456d-9564-06bba5859b08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:02.075852 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d759be6f-6cc7-456d-9564-06bba5859b08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.359373 Jun 16 16:13:02.092435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 88/144] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:01 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:02.113202 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a8014bd7-5d62-400e-a132-6e10c3cdaabc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:02.114294 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a8014bd7-5d62-400e-a132-6e10c3cdaabc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:02.131518 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a8014bd7-5d62-400e-a132-6e10c3cdaabc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:02.132410 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a8014bd7-5d62-400e-a132-6e10c3cdaabc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:02.135476 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a8014bd7-5d62-400e-a132-6e10c3cdaabc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:02.137461 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a8014bd7-5d62-400e-a132-6e10c3cdaabc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:02.159668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:02.200260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4cc5fccb-df62-41fc-be3d-a1c7adad8f2d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "POST /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.386396 Jun 16 16:13:02.205100 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 57/145] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 16:12:52 2022] POST /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a/os-volume_attachments => generated 194 bytes in 9393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:13:02.550026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a8014bd7-5d62-400e-a132-6e10c3cdaabc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:02.580681 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a8014bd7-5d62-400e-a132-6e10c3cdaabc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.480096 Jun 16 16:13:02.581580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 89/146] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:02 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:02.739541 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-cec65b4a-c04d-4345-985c-dbec79f106e6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:02.740890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-cec65b4a-c04d-4345-985c-dbec79f106e6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:02.749525 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=76 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:02.790482 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cec65b4a-c04d-4345-985c-dbec79f106e6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:02.793889 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cec65b4a-c04d-4345-985c-dbec79f106e6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:02.806034 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cec65b4a-c04d-4345-985c-dbec79f106e6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:02.810464 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cec65b4a-c04d-4345-985c-dbec79f106e6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:03.114339 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-641da16f-1750-4902-b72b-0c5a5ebb5031 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:03.115298 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-641da16f-1750-4902-b72b-0c5a5ebb5031 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:03.131139 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-641da16f-1750-4902-b72b-0c5a5ebb5031 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:03.131854 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-641da16f-1750-4902-b72b-0c5a5ebb5031 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:03.133108 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-641da16f-1750-4902-b72b-0c5a5ebb5031 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:03.133703 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-641da16f-1750-4902-b72b-0c5a5ebb5031 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:03.232985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-cec65b4a-c04d-4345-985c-dbec79f106e6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:03.267840 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-cec65b4a-c04d-4345-985c-dbec79f106e6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.532909 Jun 16 16:13:03.269626 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 58/147] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:02 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:03.362574 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-641da16f-1750-4902-b72b-0c5a5ebb5031 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:03.378304 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-641da16f-1750-4902-b72b-0c5a5ebb5031 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.272725 Jun 16 16:13:03.381089 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 90/148] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:03 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:03.620158 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-9dddc360-3d3a-437d-9133-23bbd20bd56d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:03.623876 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-9dddc360-3d3a-437d-9133-23bbd20bd56d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:03.644242 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9dddc360-3d3a-437d-9133-23bbd20bd56d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:03.645356 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9dddc360-3d3a-437d-9133-23bbd20bd56d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:03.649753 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9dddc360-3d3a-437d-9133-23bbd20bd56d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:03.650482 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9dddc360-3d3a-437d-9133-23bbd20bd56d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:03.965277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-9dddc360-3d3a-437d-9133-23bbd20bd56d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:03.971709 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-eca1e77f-ebce-4d24-8cd3-153784c34d4d req-4876bd36-263d-4b49-8437-cd0c11197fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e263395e-8f5e-4b76-85de-41bf42f947ae", "name": "network-vif-plugged", "status": "completed", "tag": "bef1a992-09d2-465a-ab42-4a79a9fd1971"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:03.999768 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-eca1e77f-ebce-4d24-8cd3-153784c34d4d req-4876bd36-263d-4b49-8437-cd0c11197fb1 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:04.000246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-eca1e77f-ebce-4d24-8cd3-153784c34d4d req-4876bd36-263d-4b49-8437-cd0c11197fb1 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:04.002645 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-9dddc360-3d3a-437d-9133-23bbd20bd56d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.393906 Jun 16 16:13:04.005401 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 59/149] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:03 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:04.047038 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-eca1e77f-ebce-4d24-8cd3-153784c34d4d req-4876bd36-263d-4b49-8437-cd0c11197fb1 service nova] Creating event network-vif-plugged:bef1a992-09d2-465a-ab42-4a79a9fd1971 for instance e263395e-8f5e-4b76-85de-41bf42f947ae on hv-cinder-83716 Jun 16 16:13:04.064351 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-eca1e77f-ebce-4d24-8cd3-153784c34d4d req-4876bd36-263d-4b49-8437-cd0c11197fb1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097134 Jun 16 16:13:04.064989 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 91/150] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:13:04.290266 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-132188cd-0493-4315-b8b2-0b8490564eb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:04.290898 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-132188cd-0493-4315-b8b2-0b8490564eb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:04.310168 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-132188cd-0493-4315-b8b2-0b8490564eb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:04.311352 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-132188cd-0493-4315-b8b2-0b8490564eb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:04.312713 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-132188cd-0493-4315-b8b2-0b8490564eb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:04.316039 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-132188cd-0493-4315-b8b2-0b8490564eb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:04.403767 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b4c7b385-1cf6-4380-8ff2-02efbd5656f7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:04.404552 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b4c7b385-1cf6-4380-8ff2-02efbd5656f7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:04.421214 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b4c7b385-1cf6-4380-8ff2-02efbd5656f7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:04.421913 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b4c7b385-1cf6-4380-8ff2-02efbd5656f7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:04.426131 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b4c7b385-1cf6-4380-8ff2-02efbd5656f7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:04.429515 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b4c7b385-1cf6-4380-8ff2-02efbd5656f7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:04.867523 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b4c7b385-1cf6-4380-8ff2-02efbd5656f7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:04.882124 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b4c7b385-1cf6-4380-8ff2-02efbd5656f7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.485431 Jun 16 16:13:04.883414 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 92/151] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:04 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:05.015998 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-132188cd-0493-4315-b8b2-0b8490564eb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:05.026347 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bf7603ea-409b-4e42-8778-a18ebaa48ba8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:05.028619 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bf7603ea-409b-4e42-8778-a18ebaa48ba8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:05.042375 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf7603ea-409b-4e42-8778-a18ebaa48ba8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:05.044246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf7603ea-409b-4e42-8778-a18ebaa48ba8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:05.045425 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf7603ea-409b-4e42-8778-a18ebaa48ba8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:05.046272 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bf7603ea-409b-4e42-8778-a18ebaa48ba8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:05.068625 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-132188cd-0493-4315-b8b2-0b8490564eb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.782881 Jun 16 16:13:05.084010 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 60/152] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:04 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:05.293147 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bf7603ea-409b-4e42-8778-a18ebaa48ba8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:05.314381 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bf7603ea-409b-4e42-8778-a18ebaa48ba8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.293602 Jun 16 16:13:05.318726 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 93/153] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:05 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:05.918653 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fefd40ca-a4ec-4194-908f-b3ee34ef5f27 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:05.919977 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-fefd40ca-a4ec-4194-908f-b3ee34ef5f27 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:05.941268 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fefd40ca-a4ec-4194-908f-b3ee34ef5f27 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:05.942679 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fefd40ca-a4ec-4194-908f-b3ee34ef5f27 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:05.944527 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fefd40ca-a4ec-4194-908f-b3ee34ef5f27 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:05.946621 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fefd40ca-a4ec-4194-908f-b3ee34ef5f27 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:06.104352 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-652f5fbc-f514-413b-b8f7-152399080a17 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:06.117900 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-652f5fbc-f514-413b-b8f7-152399080a17 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:06.144860 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-652f5fbc-f514-413b-b8f7-152399080a17 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:06.146564 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-652f5fbc-f514-413b-b8f7-152399080a17 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:06.149017 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-652f5fbc-f514-413b-b8f7-152399080a17 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:06.150616 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-652f5fbc-f514-413b-b8f7-152399080a17 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:06.309273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fefd40ca-a4ec-4194-908f-b3ee34ef5f27 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:06.338464 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fefd40ca-a4ec-4194-908f-b3ee34ef5f27 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1365 microversion: 2.1 time: 0.427993 Jun 16 16:13:06.340809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 61/154] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:05 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1365 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:06.350235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-27fe8fab-1590-4f14-92bc-cf2f576e34f3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:06.352343 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-27fe8fab-1590-4f14-92bc-cf2f576e34f3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:06.375621 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-27fe8fab-1590-4f14-92bc-cf2f576e34f3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:06.376624 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-27fe8fab-1590-4f14-92bc-cf2f576e34f3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:06.377685 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-27fe8fab-1590-4f14-92bc-cf2f576e34f3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:06.379358 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-27fe8fab-1590-4f14-92bc-cf2f576e34f3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:06.624455 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-652f5fbc-f514-413b-b8f7-152399080a17 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:06.646335 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-652f5fbc-f514-413b-b8f7-152399080a17 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.552272 Jun 16 16:13:06.667178 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 94/155] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:06 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:06.675673 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-930b0a8f-6682-4cd9-ad08-e64fc26d301e req-98e40fd1-2065-4cec-8f46-84ee5a2f0444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b69f513-c146-469b-9045-a974844f18cb", "name": "network-vif-plugged", "status": "completed", "tag": "b45f5873-c9a8-45d9-883c-9f0d81681036"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:06.717551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-930b0a8f-6682-4cd9-ad08-e64fc26d301e req-98e40fd1-2065-4cec-8f46-84ee5a2f0444 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:06.718994 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-930b0a8f-6682-4cd9-ad08-e64fc26d301e req-98e40fd1-2065-4cec-8f46-84ee5a2f0444 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:06.756641 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-27fe8fab-1590-4f14-92bc-cf2f576e34f3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:06.763236 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-930b0a8f-6682-4cd9-ad08-e64fc26d301e req-98e40fd1-2065-4cec-8f46-84ee5a2f0444 service nova] Creating event network-vif-plugged:b45f5873-c9a8-45d9-883c-9f0d81681036 for instance 6b69f513-c146-469b-9045-a974844f18cb on hv-cinder-83716 Jun 16 16:13:06.775153 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-27fe8fab-1590-4f14-92bc-cf2f576e34f3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.432247 Jun 16 16:13:06.778492 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 62/156] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:06 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:06.800211 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-930b0a8f-6682-4cd9-ad08-e64fc26d301e req-98e40fd1-2065-4cec-8f46-84ee5a2f0444 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127943 Jun 16 16:13:06.810813 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 95/157] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:07.375014 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e64e725f-81ab-4b0b-b317-4c49576fd9b2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:07.378040 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e64e725f-81ab-4b0b-b317-4c49576fd9b2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:07.410982 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e64e725f-81ab-4b0b-b317-4c49576fd9b2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:07.415140 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e64e725f-81ab-4b0b-b317-4c49576fd9b2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:07.420753 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e64e725f-81ab-4b0b-b317-4c49576fd9b2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:07.426408 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e64e725f-81ab-4b0b-b317-4c49576fd9b2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:07.679529 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5546979c-7a9f-4bf7-8bac-a28bfdcc8423 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:07.680661 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5546979c-7a9f-4bf7-8bac-a28bfdcc8423 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:07.713252 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5546979c-7a9f-4bf7-8bac-a28bfdcc8423 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:07.715757 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5546979c-7a9f-4bf7-8bac-a28bfdcc8423 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:07.719883 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5546979c-7a9f-4bf7-8bac-a28bfdcc8423 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:07.720739 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5546979c-7a9f-4bf7-8bac-a28bfdcc8423 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:07.798493 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e64e725f-81ab-4b0b-b317-4c49576fd9b2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:07.810176 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e64e725f-81ab-4b0b-b317-4c49576fd9b2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1555 microversion: 2.1 time: 0.452041 Jun 16 16:13:07.822314 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 63/158] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:07 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1555 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:07.848474 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-22753dac-dd2d-4000-bab1-8d03dda28c5a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:07.850162 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-22753dac-dd2d-4000-bab1-8d03dda28c5a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:07.875297 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-22753dac-dd2d-4000-bab1-8d03dda28c5a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:07.901653 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-22753dac-dd2d-4000-bab1-8d03dda28c5a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:07.907444 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-22753dac-dd2d-4000-bab1-8d03dda28c5a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:07.908221 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-22753dac-dd2d-4000-bab1-8d03dda28c5a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:08.129570 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5546979c-7a9f-4bf7-8bac-a28bfdcc8423 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:08.149359 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5546979c-7a9f-4bf7-8bac-a28bfdcc8423 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.477177 Jun 16 16:13:08.153703 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 96/159] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:07 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:08.181883 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-34a31923-e4f5-4137-904c-2f8d869734d8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:08.182990 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-34a31923-e4f5-4137-904c-2f8d869734d8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:08.196157 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-34a31923-e4f5-4137-904c-2f8d869734d8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:08.196688 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-34a31923-e4f5-4137-904c-2f8d869734d8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:08.197686 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-34a31923-e4f5-4137-904c-2f8d869734d8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:08.198179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-34a31923-e4f5-4137-904c-2f8d869734d8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:08.342382 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-34a31923-e4f5-4137-904c-2f8d869734d8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.186741 Jun 16 16:13:08.343557 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 97/160] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 16:13:08 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/os-interface => generated 285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:08.384341 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-22753dac-dd2d-4000-bab1-8d03dda28c5a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:08.403366 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-22753dac-dd2d-4000-bab1-8d03dda28c5a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.567753 Jun 16 16:13:08.404348 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 64/161] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:07 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:09.180202 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7b61b5ae-925f-42f9-9a44-9e01fa57166a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:09.181359 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7b61b5ae-925f-42f9-9a44-9e01fa57166a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:09.200758 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b61b5ae-925f-42f9-9a44-9e01fa57166a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:09.202027 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b61b5ae-925f-42f9-9a44-9e01fa57166a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:09.204371 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b61b5ae-925f-42f9-9a44-9e01fa57166a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:09.206097 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7b61b5ae-925f-42f9-9a44-9e01fa57166a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:09.435086 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-91f67f2a-8783-433e-a72a-50e381e319ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:09.438784 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-91f67f2a-8783-433e-a72a-50e381e319ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:09.460022 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-91f67f2a-8783-433e-a72a-50e381e319ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:09.469982 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-91f67f2a-8783-433e-a72a-50e381e319ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:09.471810 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-91f67f2a-8783-433e-a72a-50e381e319ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:09.472683 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-91f67f2a-8783-433e-a72a-50e381e319ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:09.778933 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-91f67f2a-8783-433e-a72a-50e381e319ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:09.797407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-91f67f2a-8783-433e-a72a-50e381e319ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.378711 Jun 16 16:13:09.814502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 65/162] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:09 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:10.127206 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7b61b5ae-925f-42f9-9a44-9e01fa57166a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:10.155326 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7b61b5ae-925f-42f9-9a44-9e01fa57166a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.975031 Jun 16 16:13:10.159432 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 98/163] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:09 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:10.827187 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-486805ec-516f-448e-88a8-f9d30fb4f2fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:10.829357 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-486805ec-516f-448e-88a8-f9d30fb4f2fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:10.842534 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-486805ec-516f-448e-88a8-f9d30fb4f2fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:10.844202 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-486805ec-516f-448e-88a8-f9d30fb4f2fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:10.845367 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-486805ec-516f-448e-88a8-f9d30fb4f2fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:10.846292 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-486805ec-516f-448e-88a8-f9d30fb4f2fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:11.183579 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-66e6e32e-554f-48c4-b1cc-4373c477ad8f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:11.185658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-66e6e32e-554f-48c4-b1cc-4373c477ad8f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:11.199489 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-66e6e32e-554f-48c4-b1cc-4373c477ad8f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:11.200199 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-66e6e32e-554f-48c4-b1cc-4373c477ad8f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:11.201538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-66e6e32e-554f-48c4-b1cc-4373c477ad8f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:11.202478 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-66e6e32e-554f-48c4-b1cc-4373c477ad8f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:11.437587 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-486805ec-516f-448e-88a8-f9d30fb4f2fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:11.437587 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-486805ec-516f-448e-88a8-f9d30fb4f2fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.603676 Jun 16 16:13:11.437587 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 66/164] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:10 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:11.532415 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-66e6e32e-554f-48c4-b1cc-4373c477ad8f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:11.548159 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-66e6e32e-554f-48c4-b1cc-4373c477ad8f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.369236 Jun 16 16:13:11.550001 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 99/165] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:11 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:11.654301 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-04af8458-a418-4f4b-862a-0b4cc92cefac req-46d45372-42f3-43cc-8082-ed05d44b7ded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e263395e-8f5e-4b76-85de-41bf42f947ae", "tag": "bef1a992-09d2-465a-ab42-4a79a9fd1971"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:11.669920 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-04af8458-a418-4f4b-862a-0b4cc92cefac req-46d45372-42f3-43cc-8082-ed05d44b7ded service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:11.671016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-04af8458-a418-4f4b-862a-0b4cc92cefac req-46d45372-42f3-43cc-8082-ed05d44b7ded service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:11.694163 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-04af8458-a418-4f4b-862a-0b4cc92cefac req-46d45372-42f3-43cc-8082-ed05d44b7ded service nova] Creating event network-changed:bef1a992-09d2-465a-ab42-4a79a9fd1971 for instance e263395e-8f5e-4b76-85de-41bf42f947ae on hv-cinder-83716 Jun 16 16:13:11.703301 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-04af8458-a418-4f4b-862a-0b4cc92cefac req-46d45372-42f3-43cc-8082-ed05d44b7ded service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056909 Jun 16 16:13:11.704134 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 67/166] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:12.464086 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-13799604-815e-49cf-9b7e-5165416dbc0b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:12.465505 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-13799604-815e-49cf-9b7e-5165416dbc0b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:12.490637 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-13799604-815e-49cf-9b7e-5165416dbc0b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:12.491459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-13799604-815e-49cf-9b7e-5165416dbc0b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:12.492800 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-13799604-815e-49cf-9b7e-5165416dbc0b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:12.493592 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-13799604-815e-49cf-9b7e-5165416dbc0b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:12.582848 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-06a59bb3-f4b0-4eeb-bad6-5c412f6bc307 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:12.594331 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-06a59bb3-f4b0-4eeb-bad6-5c412f6bc307 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:12.634206 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-06a59bb3-f4b0-4eeb-bad6-5c412f6bc307 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:12.635570 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-06a59bb3-f4b0-4eeb-bad6-5c412f6bc307 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:12.637055 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-06a59bb3-f4b0-4eeb-bad6-5c412f6bc307 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:12.639245 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-06a59bb3-f4b0-4eeb-bad6-5c412f6bc307 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:13.033071 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-13799604-815e-49cf-9b7e-5165416dbc0b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:13.060232 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-13799604-815e-49cf-9b7e-5165416dbc0b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1361 microversion: 2.1 time: 0.604084 Jun 16 16:13:13.061263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 100/167] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:12 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1361 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:13.227506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-06a59bb3-f4b0-4eeb-bad6-5c412f6bc307 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:13.242616 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-06a59bb3-f4b0-4eeb-bad6-5c412f6bc307 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.671149 Jun 16 16:13:13.258114 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 68/168] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:12 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:14.048542 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f98a27a9-6e0b-4e56-87ca-5e6a632e2732 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:14.051608 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f98a27a9-6e0b-4e56-87ca-5e6a632e2732 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:14.063211 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f98a27a9-6e0b-4e56-87ca-5e6a632e2732 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:14.064388 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f98a27a9-6e0b-4e56-87ca-5e6a632e2732 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:14.065975 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f98a27a9-6e0b-4e56-87ca-5e6a632e2732 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:14.066913 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f98a27a9-6e0b-4e56-87ca-5e6a632e2732 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:14.086850 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4d5be20f-de6b-4f04-aebb-9fed2fb4262f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:14.088774 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4d5be20f-de6b-4f04-aebb-9fed2fb4262f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:14.111208 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4d5be20f-de6b-4f04-aebb-9fed2fb4262f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:14.115954 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4d5be20f-de6b-4f04-aebb-9fed2fb4262f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:14.118538 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4d5be20f-de6b-4f04-aebb-9fed2fb4262f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:14.121174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4d5be20f-de6b-4f04-aebb-9fed2fb4262f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:14.180557 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f98a27a9-6e0b-4e56-87ca-5e6a632e2732 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:13:14.412743 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f98a27a9-6e0b-4e56-87ca-5e6a632e2732 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "DELETE /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 204 len: 0 microversion: 2.1 time: 0.370399 Jun 16 16:13:14.413348 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 101/169] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:13:14 2022] DELETE /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:13:14.430601 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bb1a68e0-ebce-4971-b016-70e03cb525b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:14.432926 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bb1a68e0-ebce-4971-b016-70e03cb525b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:14.446680 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb1a68e0-ebce-4971-b016-70e03cb525b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:14.447172 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb1a68e0-ebce-4971-b016-70e03cb525b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:14.447954 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb1a68e0-ebce-4971-b016-70e03cb525b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:14.448918 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb1a68e0-ebce-4971-b016-70e03cb525b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:14.686463 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4d5be20f-de6b-4f04-aebb-9fed2fb4262f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:14.698208 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4d5be20f-de6b-4f04-aebb-9fed2fb4262f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1547 microversion: 2.1 time: 0.619033 Jun 16 16:13:14.699319 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 69/170] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:14 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1547 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:14.705904 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b161da1d-b79b-4707-93e7-136a60792b4d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:14.708432 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b161da1d-b79b-4707-93e7-136a60792b4d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:14.720429 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b161da1d-b79b-4707-93e7-136a60792b4d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:14.721139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b161da1d-b79b-4707-93e7-136a60792b4d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:14.722202 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b161da1d-b79b-4707-93e7-136a60792b4d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:14.722862 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b161da1d-b79b-4707-93e7-136a60792b4d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:14.860414 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bb1a68e0-ebce-4971-b016-70e03cb525b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:14.883842 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bb1a68e0-ebce-4971-b016-70e03cb525b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.464759 Jun 16 16:13:14.884727 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 102/171] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:14 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:14.913964 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7f042974-297b-4ed9-b974-5c7b47d46784 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:14.913964 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7f042974-297b-4ed9-b974-5c7b47d46784 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:14.915072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7f042974-297b-4ed9-b974-5c7b47d46784 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:14.916039 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7f042974-297b-4ed9-b974-5c7b47d46784 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:14.917762 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7f042974-297b-4ed9-b974-5c7b47d46784 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:14.918827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7f042974-297b-4ed9-b974-5c7b47d46784 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:15.055460 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b161da1d-b79b-4707-93e7-136a60792b4d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:15.080164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b161da1d-b79b-4707-93e7-136a60792b4d tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1552 microversion: 2.1 time: 0.374454 Jun 16 16:13:15.081162 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 70/172] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:14 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1552 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:15.082011 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7f042974-297b-4ed9-b974-5c7b47d46784 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.194350 Jun 16 16:13:15.083431 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 103/173] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 16:13:14 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:15.911823 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-83f6140b-e8b5-43a5-9ba3-42ee4c2b8fbd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:15.912913 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-83f6140b-e8b5-43a5-9ba3-42ee4c2b8fbd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:15.973050 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-83f6140b-e8b5-43a5-9ba3-42ee4c2b8fbd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:15.974057 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-83f6140b-e8b5-43a5-9ba3-42ee4c2b8fbd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:15.975445 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-83f6140b-e8b5-43a5-9ba3-42ee4c2b8fbd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:15.976064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-83f6140b-e8b5-43a5-9ba3-42ee4c2b8fbd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:16.108509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-698ff9c6-c1ef-4be6-a1d7-e3a2bcf3debf tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:16.109781 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-698ff9c6-c1ef-4be6-a1d7-e3a2bcf3debf tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:16.125309 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-698ff9c6-c1ef-4be6-a1d7-e3a2bcf3debf tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:16.126783 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-698ff9c6-c1ef-4be6-a1d7-e3a2bcf3debf tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:16.128396 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-698ff9c6-c1ef-4be6-a1d7-e3a2bcf3debf tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:16.129392 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-698ff9c6-c1ef-4be6-a1d7-e3a2bcf3debf tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:16.402222 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-698ff9c6-c1ef-4be6-a1d7-e3a2bcf3debf tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:16.417700 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-83f6140b-e8b5-43a5-9ba3-42ee4c2b8fbd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:16.418271 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-698ff9c6-c1ef-4be6-a1d7-e3a2bcf3debf tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1552 microversion: 2.1 time: 0.320871 Jun 16 16:13:16.419212 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 71/174] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:16 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1552 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:16.454356 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-83f6140b-e8b5-43a5-9ba3-42ee4c2b8fbd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.549980 Jun 16 16:13:16.471613 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 104/175] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:15 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:17.008737 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-d7168af7-ab74-43aa-a7ec-316ea69b2f09 req-5eb70127-e7b9-4a20-b2fc-ec0da06937ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b69f513-c146-469b-9045-a974844f18cb", "tag": "b45f5873-c9a8-45d9-883c-9f0d81681036"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:17.029368 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-d7168af7-ab74-43aa-a7ec-316ea69b2f09 req-5eb70127-e7b9-4a20-b2fc-ec0da06937ea service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:17.031239 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-d7168af7-ab74-43aa-a7ec-316ea69b2f09 req-5eb70127-e7b9-4a20-b2fc-ec0da06937ea service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:17.054775 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-d7168af7-ab74-43aa-a7ec-316ea69b2f09 req-5eb70127-e7b9-4a20-b2fc-ec0da06937ea service nova] Creating event network-changed:b45f5873-c9a8-45d9-883c-9f0d81681036 for instance 6b69f513-c146-469b-9045-a974844f18cb on hv-cinder-83716 Jun 16 16:13:17.064536 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-d7168af7-ab74-43aa-a7ec-316ea69b2f09 req-5eb70127-e7b9-4a20-b2fc-ec0da06937ea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063554 Jun 16 16:13:17.065707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 72/176] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:17.461479 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fe923073-5245-48ad-8f0d-5670e19649a5 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:17.464878 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fe923073-5245-48ad-8f0d-5670e19649a5 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:17.480018 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fe923073-5245-48ad-8f0d-5670e19649a5 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:17.481235 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fe923073-5245-48ad-8f0d-5670e19649a5 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:17.482967 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-cc69104f-c9f1-4b5d-a2d3-40706b15dfbf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:17.483757 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-cc69104f-c9f1-4b5d-a2d3-40706b15dfbf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:17.484454 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fe923073-5245-48ad-8f0d-5670e19649a5 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:17.485137 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fe923073-5245-48ad-8f0d-5670e19649a5 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:17.497143 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cc69104f-c9f1-4b5d-a2d3-40706b15dfbf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:17.501256 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cc69104f-c9f1-4b5d-a2d3-40706b15dfbf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:17.502520 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cc69104f-c9f1-4b5d-a2d3-40706b15dfbf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:17.505396 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cc69104f-c9f1-4b5d-a2d3-40706b15dfbf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:17.549704 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:17.820683 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fe923073-5245-48ad-8f0d-5670e19649a5 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:17.839450 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fe923073-5245-48ad-8f0d-5670e19649a5 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1552 microversion: 2.1 time: 0.390471 Jun 16 16:13:17.841400 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 105/177] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:17 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1552 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:17.850489 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-cc69104f-c9f1-4b5d-a2d3-40706b15dfbf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:17.860711 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-cc69104f-c9f1-4b5d-a2d3-40706b15dfbf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.384013 Jun 16 16:13:17.874123 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 73/178] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:17 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:18.862391 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-dd084cf2-71f6-4c94-86f1-5218a9d9607e tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:18.863117 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-dd084cf2-71f6-4c94-86f1-5218a9d9607e tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:18.875857 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dd084cf2-71f6-4c94-86f1-5218a9d9607e tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:18.876603 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dd084cf2-71f6-4c94-86f1-5218a9d9607e tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:18.880075 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dd084cf2-71f6-4c94-86f1-5218a9d9607e tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:18.880849 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dd084cf2-71f6-4c94-86f1-5218a9d9607e tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:18.886366 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-9e067b2a-cd20-4548-9e39-01dc186e1615 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:18.887730 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-9e067b2a-cd20-4548-9e39-01dc186e1615 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:18.910744 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9e067b2a-cd20-4548-9e39-01dc186e1615 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:18.911594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9e067b2a-cd20-4548-9e39-01dc186e1615 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:18.913210 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9e067b2a-cd20-4548-9e39-01dc186e1615 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:18.914021 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9e067b2a-cd20-4548-9e39-01dc186e1615 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:19.135207 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-9e067b2a-cd20-4548-9e39-01dc186e1615 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:19.149608 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-9e067b2a-cd20-4548-9e39-01dc186e1615 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.272321 Jun 16 16:13:19.150711 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 74/179] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:18 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:19.251721 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-dd084cf2-71f6-4c94-86f1-5218a9d9607e tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:19.261573 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-dd084cf2-71f6-4c94-86f1-5218a9d9607e tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1552 microversion: 2.1 time: 0.402646 Jun 16 16:13:19.262250 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 106/180] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:18 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1552 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:20.175515 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1170e075-ec43-4b6f-81af-bb18f1eecf03 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:20.176524 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1170e075-ec43-4b6f-81af-bb18f1eecf03 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:20.189549 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1170e075-ec43-4b6f-81af-bb18f1eecf03 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:20.190817 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1170e075-ec43-4b6f-81af-bb18f1eecf03 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:20.191738 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1170e075-ec43-4b6f-81af-bb18f1eecf03 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:20.192524 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1170e075-ec43-4b6f-81af-bb18f1eecf03 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:20.224897 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:20.284430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d3923f3a-57c9-4e81-ad19-a6b7b33aab69 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:20.286596 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d3923f3a-57c9-4e81-ad19-a6b7b33aab69 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:20.299670 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d3923f3a-57c9-4e81-ad19-a6b7b33aab69 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:20.300458 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d3923f3a-57c9-4e81-ad19-a6b7b33aab69 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:20.301824 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d3923f3a-57c9-4e81-ad19-a6b7b33aab69 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:20.302625 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d3923f3a-57c9-4e81-ad19-a6b7b33aab69 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:20.430643 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1170e075-ec43-4b6f-81af-bb18f1eecf03 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:20.449575 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1170e075-ec43-4b6f-81af-bb18f1eecf03 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.280696 Jun 16 16:13:20.450847 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 75/181] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:20 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:20.491809 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d3923f3a-57c9-4e81-ad19-a6b7b33aab69 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:20.509822 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d3923f3a-57c9-4e81-ad19-a6b7b33aab69 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1552 microversion: 2.1 time: 0.231868 Jun 16 16:13:20.510824 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 107/182] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:20 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1552 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:21.474580 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fd1a7e7e-0672-413a-b17b-9a6781f4bb2b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:21.475267 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-fd1a7e7e-0672-413a-b17b-9a6781f4bb2b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:21.486420 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fd1a7e7e-0672-413a-b17b-9a6781f4bb2b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:21.486875 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fd1a7e7e-0672-413a-b17b-9a6781f4bb2b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:21.487668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fd1a7e7e-0672-413a-b17b-9a6781f4bb2b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:21.488110 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fd1a7e7e-0672-413a-b17b-9a6781f4bb2b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:21.537771 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f517a1b3-5ddd-40eb-a939-e2b0265da091 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:21.541007 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f517a1b3-5ddd-40eb-a939-e2b0265da091 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:21.571018 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f517a1b3-5ddd-40eb-a939-e2b0265da091 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:21.572919 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f517a1b3-5ddd-40eb-a939-e2b0265da091 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:21.575281 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f517a1b3-5ddd-40eb-a939-e2b0265da091 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:21.578024 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f517a1b3-5ddd-40eb-a939-e2b0265da091 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:21.931174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fd1a7e7e-0672-413a-b17b-9a6781f4bb2b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:21.953438 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fd1a7e7e-0672-413a-b17b-9a6781f4bb2b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.482470 Jun 16 16:13:21.969967 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 76/183] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:21 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:22.072096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f517a1b3-5ddd-40eb-a939-e2b0265da091 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:22.083323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f517a1b3-5ddd-40eb-a939-e2b0265da091 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1552 microversion: 2.1 time: 0.558529 Jun 16 16:13:22.087177 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 108/184] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:21 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1552 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:22.471580 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-6f05236e-9a0f-4926-9b89-6f961be42d26 req-a7127686-f9d7-4b9d-ad56-771345f9895f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179d422e-be19-4c93-ad79-136aeb12c79a", "name": "network-vif-deleted", "tag": "c019be23-ca59-4fbc-9e0d-aaca2c69887b"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:22.488811 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-6f05236e-9a0f-4926-9b89-6f961be42d26 req-a7127686-f9d7-4b9d-ad56-771345f9895f service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:22.490019 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-6f05236e-9a0f-4926-9b89-6f961be42d26 req-a7127686-f9d7-4b9d-ad56-771345f9895f service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:22.509855 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-6f05236e-9a0f-4926-9b89-6f961be42d26 req-a7127686-f9d7-4b9d-ad56-771345f9895f service nova] Creating event network-vif-deleted:c019be23-ca59-4fbc-9e0d-aaca2c69887b for instance 179d422e-be19-4c93-ad79-136aeb12c79a on hv-cinder-83716 Jun 16 16:13:22.516706 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-6f05236e-9a0f-4926-9b89-6f961be42d26 req-a7127686-f9d7-4b9d-ad56-771345f9895f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049741 Jun 16 16:13:22.517899 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 77/185] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:13:22.986300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2ac8c8ee-bded-41b6-8768-d981cd64ed80 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:22.987094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2ac8c8ee-bded-41b6-8768-d981cd64ed80 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:22.993493 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ac8c8ee-bded-41b6-8768-d981cd64ed80 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:22.993960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ac8c8ee-bded-41b6-8768-d981cd64ed80 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:22.994800 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ac8c8ee-bded-41b6-8768-d981cd64ed80 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:22.995252 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ac8c8ee-bded-41b6-8768-d981cd64ed80 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:23.117582 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-48cd1b60-f128-4ed6-880d-2fa31834c81f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:23.119154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-48cd1b60-f128-4ed6-880d-2fa31834c81f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:23.131530 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-48cd1b60-f128-4ed6-880d-2fa31834c81f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:23.132988 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-48cd1b60-f128-4ed6-880d-2fa31834c81f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:23.134439 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-48cd1b60-f128-4ed6-880d-2fa31834c81f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:23.135181 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-48cd1b60-f128-4ed6-880d-2fa31834c81f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:23.189593 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2ac8c8ee-bded-41b6-8768-d981cd64ed80 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:23.199843 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2ac8c8ee-bded-41b6-8768-d981cd64ed80 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.218032 Jun 16 16:13:23.200531 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 109/186] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:22 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:23.243616 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-48cd1b60-f128-4ed6-880d-2fa31834c81f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:23.257756 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-48cd1b60-f128-4ed6-880d-2fa31834c81f tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1510 microversion: 2.1 time: 0.148086 Jun 16 16:13:23.258736 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 78/187] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:23 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:24.230850 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-cbe7c825-f679-4adb-ad9d-bd76efcf1e18 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:24.231574 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-cbe7c825-f679-4adb-ad9d-bd76efcf1e18 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:24.233914 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:24.240755 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cbe7c825-f679-4adb-ad9d-bd76efcf1e18 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:24.241270 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cbe7c825-f679-4adb-ad9d-bd76efcf1e18 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:24.242224 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cbe7c825-f679-4adb-ad9d-bd76efcf1e18 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:24.242806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cbe7c825-f679-4adb-ad9d-bd76efcf1e18 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:24.284429 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-93e4c383-e7de-4012-814d-7fcdf43fd9cd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:24.286279 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-93e4c383-e7de-4012-814d-7fcdf43fd9cd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:24.297132 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-93e4c383-e7de-4012-814d-7fcdf43fd9cd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:24.298234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-93e4c383-e7de-4012-814d-7fcdf43fd9cd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:24.299625 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-93e4c383-e7de-4012-814d-7fcdf43fd9cd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:24.300396 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-93e4c383-e7de-4012-814d-7fcdf43fd9cd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:24.403726 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-93e4c383-e7de-4012-814d-7fcdf43fd9cd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:24.420350 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-93e4c383-e7de-4012-814d-7fcdf43fd9cd tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1345 microversion: 2.1 time: 0.146328 Jun 16 16:13:24.421544 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 79/188] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:24 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:24.487955 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cbe7c825-f679-4adb-ad9d-bd76efcf1e18 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:24.498993 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-cbe7c825-f679-4adb-ad9d-bd76efcf1e18 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.275112 Jun 16 16:13:24.503961 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 110/189] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:24 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:25.445793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-9a63ef28-8e31-45fb-ae9b-27cb71f5f7f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:25.446489 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-9a63ef28-8e31-45fb-ae9b-27cb71f5f7f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:25.454779 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9a63ef28-8e31-45fb-ae9b-27cb71f5f7f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:25.455285 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9a63ef28-8e31-45fb-ae9b-27cb71f5f7f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:25.456248 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9a63ef28-8e31-45fb-ae9b-27cb71f5f7f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:25.456742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9a63ef28-8e31-45fb-ae9b-27cb71f5f7f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:25.517967 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c0003ae5-0869-4a73-bcf0-c251b9d186f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:25.518854 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c0003ae5-0869-4a73-bcf0-c251b9d186f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:25.530678 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c0003ae5-0869-4a73-bcf0-c251b9d186f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:25.531281 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c0003ae5-0869-4a73-bcf0-c251b9d186f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:25.532208 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c0003ae5-0869-4a73-bcf0-c251b9d186f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:25.532869 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c0003ae5-0869-4a73-bcf0-c251b9d186f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:25.572931 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-9a63ef28-8e31-45fb-ae9b-27cb71f5f7f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:25.583351 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-9a63ef28-8e31-45fb-ae9b-27cb71f5f7f7 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1345 microversion: 2.1 time: 0.141891 Jun 16 16:13:25.584532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 80/190] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:25 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1345 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:25.732187 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c0003ae5-0869-4a73-bcf0-c251b9d186f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:25.743487 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c0003ae5-0869-4a73-bcf0-c251b9d186f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.229581 Jun 16 16:13:25.744608 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 111/191] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:25 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:26.610028 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1b7db399-70a6-432c-8b82-b558a352a064 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:26.610839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1b7db399-70a6-432c-8b82-b558a352a064 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:26.622361 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1b7db399-70a6-432c-8b82-b558a352a064 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:26.623143 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1b7db399-70a6-432c-8b82-b558a352a064 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:26.624032 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1b7db399-70a6-432c-8b82-b558a352a064 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:26.624719 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1b7db399-70a6-432c-8b82-b558a352a064 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:26.717764 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1b7db399-70a6-432c-8b82-b558a352a064 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:26.732497 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1b7db399-70a6-432c-8b82-b558a352a064 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1345 microversion: 2.1 time: 0.127947 Jun 16 16:13:26.734136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 81/192] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:26 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1345 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:26.771245 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-780129d1-e6c7-400f-a01b-628e69b13004 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:26.772272 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-780129d1-e6c7-400f-a01b-628e69b13004 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:26.799909 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-780129d1-e6c7-400f-a01b-628e69b13004 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:26.800405 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-780129d1-e6c7-400f-a01b-628e69b13004 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:26.801408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-780129d1-e6c7-400f-a01b-628e69b13004 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:26.802124 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-780129d1-e6c7-400f-a01b-628e69b13004 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:27.058914 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-780129d1-e6c7-400f-a01b-628e69b13004 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:27.068304 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-780129d1-e6c7-400f-a01b-628e69b13004 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.302453 Jun 16 16:13:27.068813 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 112/193] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:26 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:27.755902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-69667bc7-bad8-40ee-9b1e-80f363e4e0bb tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:27.758100 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-69667bc7-bad8-40ee-9b1e-80f363e4e0bb tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:27.770957 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-69667bc7-bad8-40ee-9b1e-80f363e4e0bb tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:27.771921 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-69667bc7-bad8-40ee-9b1e-80f363e4e0bb tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:27.773122 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-69667bc7-bad8-40ee-9b1e-80f363e4e0bb tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:27.773622 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-69667bc7-bad8-40ee-9b1e-80f363e4e0bb tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:27.845876 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-69667bc7-bad8-40ee-9b1e-80f363e4e0bb tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:27.846616 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-69667bc7-bad8-40ee-9b1e-80f363e4e0bb tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:27.847241 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-69667bc7-bad8-40ee-9b1e-80f363e4e0bb tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lazy-loading 'fault' on Instance uuid 179d422e-be19-4c93-ad79-136aeb12c79a {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:13:27.920141 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-69667bc7-bad8-40ee-9b1e-80f363e4e0bb tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d48e41e19584c5c8773c9f445355ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4bfae59d38461c839fc9a35eb4d6cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:27.937958 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-69667bc7-bad8-40ee-9b1e-80f363e4e0bb tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 200 len: 1304 microversion: 2.1 time: 0.187588 Jun 16 16:13:27.939255 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 82/194] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:27 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 1304 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:28.090689 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-dc679786-0d08-4441-a1f7-b72bc808fee2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:28.092540 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-dc679786-0d08-4441-a1f7-b72bc808fee2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:28.101623 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dc679786-0d08-4441-a1f7-b72bc808fee2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:28.102727 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dc679786-0d08-4441-a1f7-b72bc808fee2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:28.103848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dc679786-0d08-4441-a1f7-b72bc808fee2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:28.105511 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dc679786-0d08-4441-a1f7-b72bc808fee2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:28.346911 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-dc679786-0d08-4441-a1f7-b72bc808fee2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:28.357985 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-dc679786-0d08-4441-a1f7-b72bc808fee2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.272666 Jun 16 16:13:28.358535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 113/195] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:28 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:28.962335 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d7d95cf4-408a-4d1e-8603-76bca6751f9b tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:28.962957 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d7d95cf4-408a-4d1e-8603-76bca6751f9b tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:28.971223 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d7d95cf4-408a-4d1e-8603-76bca6751f9b tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:28.971685 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d7d95cf4-408a-4d1e-8603-76bca6751f9b tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:28.972483 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d7d95cf4-408a-4d1e-8603-76bca6751f9b tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:28.972923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d7d95cf4-408a-4d1e-8603-76bca6751f9b tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:28.988510 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-d7d95cf4-408a-4d1e-8603-76bca6751f9b tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] HTTP exception thrown: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d7d95cf4-408a-4d1e-8603-76bca6751f9b tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Request method failure captured: Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a HTTP/1.1 Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ZQAo9WIN6HUibsaYMXmEh1IHA_IscmeCQ6C4_Iewlsh5KeCE3DLo4vrSL8b3JsTAm3l206DAD5-EFviaxBBFH84O4gNlrodw6XZXPiEfXE6m7w0UTQsPjTykcZQ5myTlC0gb0oRrlMhz7QZegT9S5af5osMy6cwHWooCXpxoteR7I Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 4e4bfae59d38461c839fc9a35eb4d6cf Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-DeleteServersTestJSON-351341556 Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:13:28.993378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:13:28.995793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e4bfae59d38461c839fc9a35eb4d6cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e4bfae59d38461c839fc9a35eb4d6cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e4bfae59d38461c839fc9a35eb4d6cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e4bfae59d38461c839fc9a35eb4d6cf"}]}] Jun 16 16:13:28.995793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-DeleteServersTestJSON-351341556 Jun 16 16:13:28.995793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 4e4bfae59d38461c839fc9a35eb4d6cf Jun 16 16:13:28.995793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-DeleteServersTestJSON-351341556 Jun 16 16:13:28.995793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-DeleteServersTestJSON-351341556-project Jun 16 16:13:28.995793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:13:28.995793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:13:28.995793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 4d48e41e19584c5c8773c9f445355ff2 Jun 16 16:13:28.995793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-DeleteServersTestJSON-351341556-project Jun 16 16:13:28.995793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:13:28.995793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:28.995793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': '179d422e-be19-4c93-ad79-136aeb12c79a'} Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:13:28.996792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:28.997952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:28.999103 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d7d95cf4-408a-4d1e-8603-76bca6751f9b tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Returning 404 to user: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:13:28.999103 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d7d95cf4-408a-4d1e-8603-76bca6751f9b tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 404 len: 111 microversion: 2.1 time: 0.036813 Jun 16 16:13:28.999103 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 83/196] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:28 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:13:29.123139 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c4b41662-279b-4c4c-a098-66095b9699d0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:29.124191 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c4b41662-279b-4c4c-a098-66095b9699d0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:29.131502 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c4b41662-279b-4c4c-a098-66095b9699d0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:29.131958 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c4b41662-279b-4c4c-a098-66095b9699d0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:29.133185 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c4b41662-279b-4c4c-a098-66095b9699d0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:29.133785 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c4b41662-279b-4c4c-a098-66095b9699d0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:29.160026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-c4b41662-279b-4c4c-a098-66095b9699d0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] HTTP exception thrown: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c4b41662-279b-4c4c-a098-66095b9699d0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Request method failure captured: Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a/os-volume_attachments HTTP/1.1 Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ZQAo9WIN6HUibsaYMXmEh1IHA_IscmeCQ6C4_Iewlsh5KeCE3DLo4vrSL8b3JsTAm3l206DAD5-EFviaxBBFH84O4gNlrodw6XZXPiEfXE6m7w0UTQsPjTykcZQ5myTlC0gb0oRrlMhz7QZegT9S5af5osMy6cwHWooCXpxoteR7I Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 4e4bfae59d38461c839fc9a35eb4d6cf Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-DeleteServersTestJSON-351341556 Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:13:29.169408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:13:29.171466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e4bfae59d38461c839fc9a35eb4d6cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e4bfae59d38461c839fc9a35eb4d6cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e4bfae59d38461c839fc9a35eb4d6cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e4bfae59d38461c839fc9a35eb4d6cf"}]}] Jun 16 16:13:29.171466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-DeleteServersTestJSON-351341556 Jun 16 16:13:29.171466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 4e4bfae59d38461c839fc9a35eb4d6cf Jun 16 16:13:29.171466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-DeleteServersTestJSON-351341556 Jun 16 16:13:29.171466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-DeleteServersTestJSON-351341556-project Jun 16 16:13:29.171466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:13:29.171466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:13:29.171466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 4d48e41e19584c5c8773c9f445355ff2 Jun 16 16:13:29.171466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-DeleteServersTestJSON-351341556-project Jun 16 16:13:29.171466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:13:29.171466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:29.171466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'server_id': '179d422e-be19-4c93-ad79-136aeb12c79a'} Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:13:29.172343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:29.173968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:13:29.175301 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c4b41662-279b-4c4c-a098-66095b9699d0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Returning 404 to user: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:13:29.175301 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c4b41662-279b-4c4c-a098-66095b9699d0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.055607 Jun 16 16:13:29.175301 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 114/197] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:13:29 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a/os-volume_attachments => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:13:29.382106 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-2ac2e66e-fc95-4a86-b6e0-ad89c42796a1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:29.383074 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2ac2e66e-fc95-4a86-b6e0-ad89c42796a1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:29.392875 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2ac2e66e-fc95-4a86-b6e0-ad89c42796a1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:29.393352 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2ac2e66e-fc95-4a86-b6e0-ad89c42796a1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:29.394185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2ac2e66e-fc95-4a86-b6e0-ad89c42796a1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:29.394688 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2ac2e66e-fc95-4a86-b6e0-ad89c42796a1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:29.572148 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-2ac2e66e-fc95-4a86-b6e0-ad89c42796a1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:29.580882 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-2ac2e66e-fc95-4a86-b6e0-ad89c42796a1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.203064 Jun 16 16:13:29.581705 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 84/198] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:29 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:30.601051 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-69f61f65-9288-47a5-ae47-ff28d5ddb894 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:30.601850 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-69f61f65-9288-47a5-ae47-ff28d5ddb894 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:30.610370 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-69f61f65-9288-47a5-ae47-ff28d5ddb894 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:30.610826 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-69f61f65-9288-47a5-ae47-ff28d5ddb894 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:30.611611 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-69f61f65-9288-47a5-ae47-ff28d5ddb894 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:30.612044 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-69f61f65-9288-47a5-ae47-ff28d5ddb894 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:30.803486 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-69f61f65-9288-47a5-ae47-ff28d5ddb894 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:30.811745 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-69f61f65-9288-47a5-ae47-ff28d5ddb894 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.214514 Jun 16 16:13:30.812316 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 115/199] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:30 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:31.834883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f7574b6b-e585-4256-a0dd-a9f1c613cb55 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:31.836591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f7574b6b-e585-4256-a0dd-a9f1c613cb55 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:31.848867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f7574b6b-e585-4256-a0dd-a9f1c613cb55 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:31.849528 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f7574b6b-e585-4256-a0dd-a9f1c613cb55 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:31.850602 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f7574b6b-e585-4256-a0dd-a9f1c613cb55 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:31.851147 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f7574b6b-e585-4256-a0dd-a9f1c613cb55 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:32.171756 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f7574b6b-e585-4256-a0dd-a9f1c613cb55 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:32.181444 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f7574b6b-e585-4256-a0dd-a9f1c613cb55 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.351763 Jun 16 16:13:32.182698 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 85/200] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:31 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:32.601011 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-963954df-1ad7-4a6f-ba16-32abfda6a8f0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:32.602965 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-963954df-1ad7-4a6f-ba16-32abfda6a8f0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:32.613913 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-963954df-1ad7-4a6f-ba16-32abfda6a8f0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:32.615225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-963954df-1ad7-4a6f-ba16-32abfda6a8f0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:32.617041 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-963954df-1ad7-4a6f-ba16-32abfda6a8f0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:32.618333 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-963954df-1ad7-4a6f-ba16-32abfda6a8f0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:32.667572 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-963954df-1ad7-4a6f-ba16-32abfda6a8f0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] HTTP exception thrown: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-963954df-1ad7-4a6f-ba16-32abfda6a8f0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Request method failure captured: Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: DELETE /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a HTTP/1.1 Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ZQAo9WIN6HUibsaYMXmEh1IHA_IscmeCQ6C4_Iewlsh5KeCE3DLo4vrSL8b3JsTAm3l206DAD5-EFviaxBBFH84O4gNlrodw6XZXPiEfXE6m7w0UTQsPjTykcZQ5myTlC0gb0oRrlMhz7QZegT9S5af5osMy6cwHWooCXpxoteR7I Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 4e4bfae59d38461c839fc9a35eb4d6cf Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-DeleteServersTestJSON-351341556 Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:13:32.671258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:13:32.673808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e4bfae59d38461c839fc9a35eb4d6cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e4bfae59d38461c839fc9a35eb4d6cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e4bfae59d38461c839fc9a35eb4d6cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e4bfae59d38461c839fc9a35eb4d6cf"}]}] Jun 16 16:13:32.673808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-DeleteServersTestJSON-351341556 Jun 16 16:13:32.673808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 4e4bfae59d38461c839fc9a35eb4d6cf Jun 16 16:13:32.673808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-DeleteServersTestJSON-351341556 Jun 16 16:13:32.673808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-DeleteServersTestJSON-351341556-project Jun 16 16:13:32.673808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:13:32.673808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:13:32.673808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 4d48e41e19584c5c8773c9f445355ff2 Jun 16 16:13:32.673808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-DeleteServersTestJSON-351341556-project Jun 16 16:13:32.673808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:13:32.673808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:32.673808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': '179d422e-be19-4c93-ad79-136aeb12c79a'} Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:13:32.675136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:32.676928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:13:32.679127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-963954df-1ad7-4a6f-ba16-32abfda6a8f0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Returning 404 to user: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:13:32.679127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-963954df-1ad7-4a6f-ba16-32abfda6a8f0 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "DELETE /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 404 len: 111 microversion: 2.1 time: 0.076616 Jun 16 16:13:32.679127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 116/201] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:13:32 2022] DELETE /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:13:32.687960 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8f6d1dee-b1fd-4752-aa9e-661e170fa803 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:32.688371 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8f6d1dee-b1fd-4752-aa9e-661e170fa803 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] [instance: 179d422e-be19-4c93-ad79-136aeb12c79a] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:32.700009 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f6d1dee-b1fd-4752-aa9e-661e170fa803 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:32.700649 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f6d1dee-b1fd-4752-aa9e-661e170fa803 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:32.702085 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f6d1dee-b1fd-4752-aa9e-661e170fa803 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:32.702794 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f6d1dee-b1fd-4752-aa9e-661e170fa803 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:32.720632 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-8f6d1dee-b1fd-4752-aa9e-661e170fa803 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] HTTP exception thrown: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8f6d1dee-b1fd-4752-aa9e-661e170fa803 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Request method failure captured: Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a HTTP/1.1 Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ZQAo9WIN6HUibsaYMXmEh1IHA_IscmeCQ6C4_Iewlsh5KeCE3DLo4vrSL8b3JsTAm3l206DAD5-EFviaxBBFH84O4gNlrodw6XZXPiEfXE6m7w0UTQsPjTykcZQ5myTlC0gb0oRrlMhz7QZegT9S5af5osMy6cwHWooCXpxoteR7I Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 4e4bfae59d38461c839fc9a35eb4d6cf Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-DeleteServersTestJSON-351341556 Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:13:32.722468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:13:32.723609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e4bfae59d38461c839fc9a35eb4d6cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e4bfae59d38461c839fc9a35eb4d6cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e4bfae59d38461c839fc9a35eb4d6cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e4bfae59d38461c839fc9a35eb4d6cf"}]}] Jun 16 16:13:32.723609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-DeleteServersTestJSON-351341556 Jun 16 16:13:32.723609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 4e4bfae59d38461c839fc9a35eb4d6cf Jun 16 16:13:32.723609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-DeleteServersTestJSON-351341556 Jun 16 16:13:32.723609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-DeleteServersTestJSON-351341556-project Jun 16 16:13:32.723609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:13:32.723609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:13:32.723609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 4d48e41e19584c5c8773c9f445355ff2 Jun 16 16:13:32.723609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-DeleteServersTestJSON-351341556-project Jun 16 16:13:32.723609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:13:32.723609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:32.723609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': '179d422e-be19-4c93-ad79-136aeb12c79a'} Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:13:32.724234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. Jun 16 16:13:32.725305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:32.727338 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8f6d1dee-b1fd-4752-aa9e-661e170fa803 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] Returning 404 to user: Instance 179d422e-be19-4c93-ad79-136aeb12c79a could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:13:32.728325 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8f6d1dee-b1fd-4752-aa9e-661e170fa803 tempest-DeleteServersTestJSON-351341556 tempest-DeleteServersTestJSON-351341556-project] 10.222.0.17 "GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a" status: 404 len: 111 microversion: 2.1 time: 0.048125 Jun 16 16:13:32.728891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 86/202] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:32 2022] GET /compute/v2.1/servers/179d422e-be19-4c93-ad79-136aeb12c79a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:13:33.205394 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b3d31b06-f3e5-482a-8ef2-1a5fc51c049d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:33.216201 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b3d31b06-f3e5-482a-8ef2-1a5fc51c049d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:33.255053 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b3d31b06-f3e5-482a-8ef2-1a5fc51c049d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:33.261203 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b3d31b06-f3e5-482a-8ef2-1a5fc51c049d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:33.264690 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b3d31b06-f3e5-482a-8ef2-1a5fc51c049d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:33.268686 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b3d31b06-f3e5-482a-8ef2-1a5fc51c049d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:33.661305 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b3d31b06-f3e5-482a-8ef2-1a5fc51c049d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:33.675762 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b3d31b06-f3e5-482a-8ef2-1a5fc51c049d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.477893 Jun 16 16:13:33.676902 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 117/203] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:33 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:34.709414 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-14cbc050-d7f1-4b9b-b5ff-892a9bf2b01b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:34.710393 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-14cbc050-d7f1-4b9b-b5ff-892a9bf2b01b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:34.722664 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=60 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:34.742335 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-14cbc050-d7f1-4b9b-b5ff-892a9bf2b01b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:34.743714 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-14cbc050-d7f1-4b9b-b5ff-892a9bf2b01b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:34.745707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-14cbc050-d7f1-4b9b-b5ff-892a9bf2b01b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:34.746796 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-14cbc050-d7f1-4b9b-b5ff-892a9bf2b01b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:35.116500 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-14cbc050-d7f1-4b9b-b5ff-892a9bf2b01b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:35.128430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-14cbc050-d7f1-4b9b-b5ff-892a9bf2b01b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.426970 Jun 16 16:13:35.129772 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 87/204] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:34 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:36.178033 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-eb004a50-45b0-4897-b6bf-b5fc920b446c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:36.180810 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-eb004a50-45b0-4897-b6bf-b5fc920b446c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:36.194938 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eb004a50-45b0-4897-b6bf-b5fc920b446c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:36.196125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eb004a50-45b0-4897-b6bf-b5fc920b446c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:36.200058 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eb004a50-45b0-4897-b6bf-b5fc920b446c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:36.201723 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eb004a50-45b0-4897-b6bf-b5fc920b446c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:36.650094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-eb004a50-45b0-4897-b6bf-b5fc920b446c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:36.681841 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-eb004a50-45b0-4897-b6bf-b5fc920b446c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.518527 Jun 16 16:13:36.688036 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 118/205] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:36 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:37.719149 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-0c8ee80a-549a-4189-abac-4fe1d2b27aeb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:37.720019 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-0c8ee80a-549a-4189-abac-4fe1d2b27aeb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:37.734740 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0c8ee80a-549a-4189-abac-4fe1d2b27aeb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:37.735646 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0c8ee80a-549a-4189-abac-4fe1d2b27aeb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:37.736605 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0c8ee80a-549a-4189-abac-4fe1d2b27aeb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:37.737297 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0c8ee80a-549a-4189-abac-4fe1d2b27aeb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:39.012524 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-0c8ee80a-549a-4189-abac-4fe1d2b27aeb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:39.032587 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-0c8ee80a-549a-4189-abac-4fe1d2b27aeb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 1.319507 Jun 16 16:13:39.033852 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 88/206] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:37 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:40.055673 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9887a1cd-e518-46f5-8119-d6df2ed29e6e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:40.056499 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9887a1cd-e518-46f5-8119-d6df2ed29e6e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:40.070224 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9887a1cd-e518-46f5-8119-d6df2ed29e6e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:40.070846 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9887a1cd-e518-46f5-8119-d6df2ed29e6e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:40.076312 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9887a1cd-e518-46f5-8119-d6df2ed29e6e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:40.076986 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9887a1cd-e518-46f5-8119-d6df2ed29e6e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:40.564532 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9887a1cd-e518-46f5-8119-d6df2ed29e6e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:40.583951 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9887a1cd-e518-46f5-8119-d6df2ed29e6e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.532097 Jun 16 16:13:40.588666 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 119/207] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:40 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:41.604273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4c3bc806-6425-4f76-a5f4-7e948d1b5fe5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:41.607214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4c3bc806-6425-4f76-a5f4-7e948d1b5fe5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:41.622208 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4c3bc806-6425-4f76-a5f4-7e948d1b5fe5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:41.622842 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4c3bc806-6425-4f76-a5f4-7e948d1b5fe5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:41.623771 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4c3bc806-6425-4f76-a5f4-7e948d1b5fe5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:41.624285 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4c3bc806-6425-4f76-a5f4-7e948d1b5fe5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:41.868879 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4c3bc806-6425-4f76-a5f4-7e948d1b5fe5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:41.882928 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4c3bc806-6425-4f76-a5f4-7e948d1b5fe5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.285257 Jun 16 16:13:41.883933 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 89/208] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:41 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:42.913848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-018b73c0-808e-4855-8bd1-0f1c2eae683f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:42.915144 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-018b73c0-808e-4855-8bd1-0f1c2eae683f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:42.927706 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-018b73c0-808e-4855-8bd1-0f1c2eae683f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:42.928806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-018b73c0-808e-4855-8bd1-0f1c2eae683f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:42.930386 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-018b73c0-808e-4855-8bd1-0f1c2eae683f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:42.931649 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-018b73c0-808e-4855-8bd1-0f1c2eae683f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:43.132420 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-018b73c0-808e-4855-8bd1-0f1c2eae683f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:43.145204 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-018b73c0-808e-4855-8bd1-0f1c2eae683f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.237689 Jun 16 16:13:43.148356 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 120/209] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:42 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:44.177510 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-da7b7da0-5aad-4e06-9558-39155a5913e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:44.180739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-da7b7da0-5aad-4e06-9558-39155a5913e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:44.200166 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-da7b7da0-5aad-4e06-9558-39155a5913e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:44.201085 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-da7b7da0-5aad-4e06-9558-39155a5913e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:44.202776 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-da7b7da0-5aad-4e06-9558-39155a5913e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:44.203863 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-da7b7da0-5aad-4e06-9558-39155a5913e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:44.736192 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-da7b7da0-5aad-4e06-9558-39155a5913e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:44.751631 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-da7b7da0-5aad-4e06-9558-39155a5913e1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.580668 Jun 16 16:13:44.753487 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 90/210] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:44 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:44.974454 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-37765395-058f-415a-b436-f012e56f3033 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] Action: 'create', calling method: .version_select at 0x7f38bb790d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1557787532", "metadata": {"Type": "work"}}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:45.750951 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-37765395-058f-415a-b436-f012e56f3033 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.003896 Jun 16 16:13:45.752821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 121/211] 10.222.0.17 () {60 vars in 1155 bytes} [Thu Jun 16 16:13:44 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1008 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 16:13:45.771983 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b2b1116c-6261-4b42-ae35-7b3395a4d221 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] Calling method '.version_select at 0x7f38c0148280>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:45.781413 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-106ee706-eca3-4ae4-8dda-c243e32842d4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:45.787700 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-106ee706-eca3-4ae4-8dda-c243e32842d4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:45.830662 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-106ee706-eca3-4ae4-8dda-c243e32842d4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:45.834727 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-106ee706-eca3-4ae4-8dda-c243e32842d4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:45.841721 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-106ee706-eca3-4ae4-8dda-c243e32842d4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:45.847132 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-106ee706-eca3-4ae4-8dda-c243e32842d4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:45.906615 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b2b1116c-6261-4b42-ae35-7b3395a4d221 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add" status: 200 len: 353 microversion: 2.1 time: 0.143594 Jun 16 16:13:45.910076 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 91/212] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:13:45 2022] GET /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:13:46.233210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-106ee706-eca3-4ae4-8dda-c243e32842d4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:46.262103 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-106ee706-eca3-4ae4-8dda-c243e32842d4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.485111 Jun 16 16:13:46.270819 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 122/213] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:45 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:46.928503 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8ce6dfe9-8f80-434f-8251-30fa172b0088 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] Calling method '.version_select at 0x7f38c00c5d30>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:47.017713 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8ce6dfe9-8f80-434f-8251-30fa172b0088 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add" status: 200 len: 354 microversion: 2.1 time: 0.096189 Jun 16 16:13:47.018746 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 92/214] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:13:46 2022] GET /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:47.041705 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ba9616d5-f9a2-4c9d-a314-a731623a7432 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] Calling method '.version_select at 0x7f38bb7904c0>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:47.153119 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ba9616d5-f9a2-4c9d-a314-a731623a7432 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add" status: 200 len: 354 microversion: 2.1 time: 0.121948 Jun 16 16:13:47.154409 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 123/215] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:13:47 2022] GET /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:47.178678 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-2888d133-491e-4a47-9994-0489493f4b08 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] Calling method '.version_select at 0x7f38c01419d0>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:47.270774 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-2888d133-491e-4a47-9994-0489493f4b08 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add" status: 202 len: 0 microversion: 2.1 time: 0.096374 Jun 16 16:13:47.271670 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 93/216] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 16:13:47 2022] DELETE /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:13:47.284832 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ad0ccddb-895d-42fc-a583-fb4ca5671706 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] Calling method '.version_select at 0x7f38bb790af0>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:47.294897 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-65966ffb-0869-49ac-a546-c71c67240b6a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:47.295630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-65966ffb-0869-49ac-a546-c71c67240b6a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:47.302892 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-65966ffb-0869-49ac-a546-c71c67240b6a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:47.303407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-65966ffb-0869-49ac-a546-c71c67240b6a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:47.304135 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-65966ffb-0869-49ac-a546-c71c67240b6a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:47.304600 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-65966ffb-0869-49ac-a546-c71c67240b6a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:47.360618 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ad0ccddb-895d-42fc-a583-fb4ca5671706 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add" status: 200 len: 353 microversion: 2.1 time: 0.082474 Jun 16 16:13:47.361477 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 124/217] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:13:47 2022] GET /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:13:47.490236 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-65966ffb-0869-49ac-a546-c71c67240b6a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:47.501030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-65966ffb-0869-49ac-a546-c71c67240b6a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.211484 Jun 16 16:13:47.501694 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 94/218] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:47 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:48.374802 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2d13583d-91fc-49ad-a05c-67867386e537 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] Calling method '.version_select at 0x7f38bb7e73a0>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:48.431472 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2d13583d-91fc-49ad-a05c-67867386e537 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add" status: 200 len: 353 microversion: 2.1 time: 0.060514 Jun 16 16:13:48.433541 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 125/219] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:13:48 2022] GET /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:48.521376 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-08d45d76-c42d-451e-b6b5-0e50bdea6642 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:48.522058 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-08d45d76-c42d-451e-b6b5-0e50bdea6642 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:48.531825 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-08d45d76-c42d-451e-b6b5-0e50bdea6642 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:48.532188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-08d45d76-c42d-451e-b6b5-0e50bdea6642 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:48.533069 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-08d45d76-c42d-451e-b6b5-0e50bdea6642 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:48.533712 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-08d45d76-c42d-451e-b6b5-0e50bdea6642 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:48.710149 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-08d45d76-c42d-451e-b6b5-0e50bdea6642 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:48.722196 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-08d45d76-c42d-451e-b6b5-0e50bdea6642 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.204812 Jun 16 16:13:48.722784 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 95/220] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:48 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:49.449369 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f22db49d-0c84-480f-8dac-73d1870c5933 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] Calling method '.version_select at 0x7f38bb790af0>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:49.529541 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f22db49d-0c84-480f-8dac-73d1870c5933 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add" status: 200 len: 353 microversion: 2.1 time: 0.085548 Jun 16 16:13:49.530832 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 126/221] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:13:49 2022] GET /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:49.743710 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ccc4ef56-4a3c-48b4-82ec-a8269acab708 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:49.744826 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ccc4ef56-4a3c-48b4-82ec-a8269acab708 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:49.753284 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ccc4ef56-4a3c-48b4-82ec-a8269acab708 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:49.754116 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ccc4ef56-4a3c-48b4-82ec-a8269acab708 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:49.755690 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ccc4ef56-4a3c-48b4-82ec-a8269acab708 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:49.756427 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ccc4ef56-4a3c-48b4-82ec-a8269acab708 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:49.971727 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ccc4ef56-4a3c-48b4-82ec-a8269acab708 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:49.975839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=100 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:49.982308 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ccc4ef56-4a3c-48b4-82ec-a8269acab708 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.242585 Jun 16 16:13:49.982915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 96/222] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:49 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:50.395540 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-393127977", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "networks": [{"uuid": "77dab802-ad52-413c-bd18-780c89736c99"}]}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:50.550299 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e0f0ff48-e279-455c-aaeb-9503b5a81689 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] Calling method '.version_select at 0x7f38c00c5820>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:50.595323 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-e0f0ff48-e279-455c-aaeb-9503b5a81689 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] HTTP exception thrown: Volume 576a30a0-6cd2-43a1-93c1-4a66996a7add could not be found. Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e0f0ff48-e279-455c-aaeb-9503b5a81689 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] Request method failure captured: Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add HTTP/1.1 Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1a4j0RCxIueqn0VjPMwQrPZPpUkzlcEVX5SsgbyZJtAQHYC0WA5Hg2zjShB9S0yzJPiWKLMSRftvBDch4XgwR-VU-enMA0kssB08Ok9cGl8-K6ILRt3flZuNNzeL1N9SYzrTo4yhP3OG1HxiKiJch4ETaOws8MEhc7ztM3K3_97tn8 Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 10de7bebe555463c93b97f6ffc4d6dd2 Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-VolumesGetTestJSON-1357902610 Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:13:50.597773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:13:50.600428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_10de7bebe555463c93b97f6ffc4d6dd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10de7bebe555463c93b97f6ffc4d6dd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/10de7bebe555463c93b97f6ffc4d6dd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10de7bebe555463c93b97f6ffc4d6dd2"}]}] Jun 16 16:13:50.600428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-VolumesGetTestJSON-1357902610 Jun 16 16:13:50.600428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 10de7bebe555463c93b97f6ffc4d6dd2 Jun 16 16:13:50.600428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-VolumesGetTestJSON-1357902610 Jun 16 16:13:50.600428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-VolumesGetTestJSON-1357902610-project Jun 16 16:13:50.600428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:13:50.600428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:13:50.600428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 87c14a4443724bf58d04d19103d50aff Jun 16 16:13:50.600428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-VolumesGetTestJSON-1357902610-project Jun 16 16:13:50.600428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: Jun 16 16:13:50.600428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Volume 576a30a0-6cd2-43a1-93c1-4a66996a7add could not be found. Jun 16 16:13:50.600428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': '576a30a0-6cd2-43a1-93c1-4a66996a7add'} Jun 16 16:13:50.600428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 576a30a0-6cd2-43a1-93c1-4a66996a7add could not be found. (HTTP 404) (Request-ID: req-ff1c154c-1204-45d3-af2f-da66be501729) Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:13:50.601915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:13:50.604502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 576a30a0-6cd2-43a1-93c1-4a66996a7add could not be found. Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 16:13:50.607695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:13:50.611589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 576a30a0-6cd2-43a1-93c1-4a66996a7add could not be found. Jun 16 16:13:50.611589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:50.611589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:13:50.611589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:50.611589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:13:50.611589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:13:50.611589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:13:50.611589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:13:50.611589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:13:50.611589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 576a30a0-6cd2-43a1-93c1-4a66996a7add could not be found. Jun 16 16:13:50.611589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:13:50.611589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e0f0ff48-e279-455c-aaeb-9503b5a81689 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] Returning 404 to user: Volume 576a30a0-6cd2-43a1-93c1-4a66996a7add could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:13:50.611589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e0f0ff48-e279-455c-aaeb-9503b5a81689 tempest-VolumesGetTestJSON-1357902610 tempest-VolumesGetTestJSON-1357902610-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add" status: 404 len: 109 microversion: 2.1 time: 0.062031 Jun 16 16:13:50.611589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 97/223] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:13:50 2022] GET /compute/v2.1/os-volumes/576a30a0-6cd2-43a1-93c1-4a66996a7add => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:13:51.006492 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-70ddfbe1-5691-4a43-9f70-8c09dfb261ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:51.007882 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-70ddfbe1-5691-4a43-9f70-8c09dfb261ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:51.020188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-70ddfbe1-5691-4a43-9f70-8c09dfb261ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:51.020780 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-70ddfbe1-5691-4a43-9f70-8c09dfb261ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:51.021620 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-70ddfbe1-5691-4a43-9f70-8c09dfb261ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:51.022425 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-70ddfbe1-5691-4a43-9f70-8c09dfb261ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:51.262846 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-70ddfbe1-5691-4a43-9f70-8c09dfb261ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:51.274595 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-70ddfbe1-5691-4a43-9f70-8c09dfb261ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.276615 Jun 16 16:13:51.275183 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 98/224] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:50 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:52.293784 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-baf3355f-5913-4535-93a4-71498e92f8f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:52.294909 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-baf3355f-5913-4535-93a4-71498e92f8f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:52.303579 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-baf3355f-5913-4535-93a4-71498e92f8f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:52.304109 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-baf3355f-5913-4535-93a4-71498e92f8f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:52.304976 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-baf3355f-5913-4535-93a4-71498e92f8f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:52.305681 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-baf3355f-5913-4535-93a4-71498e92f8f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:52.542041 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-baf3355f-5913-4535-93a4-71498e92f8f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:52.556590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-baf3355f-5913-4535-93a4-71498e92f8f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.267134 Jun 16 16:13:52.565977 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 99/225] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:52 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:53.582714 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6c723d63-d94f-43eb-93a7-1ae86c8447ce tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:53.585328 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6c723d63-d94f-43eb-93a7-1ae86c8447ce tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:53.597716 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6c723d63-d94f-43eb-93a7-1ae86c8447ce tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:53.598605 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6c723d63-d94f-43eb-93a7-1ae86c8447ce tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:53.600181 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6c723d63-d94f-43eb-93a7-1ae86c8447ce tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:53.600623 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6c723d63-d94f-43eb-93a7-1ae86c8447ce tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:53.845208 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6c723d63-d94f-43eb-93a7-1ae86c8447ce tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:53.860754 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6c723d63-d94f-43eb-93a7-1ae86c8447ce tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.286492 Jun 16 16:13:53.872443 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 100/226] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:53 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:54.878865 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4d30e9fe-327f-41d2-a8fe-a7a9c11d1b3c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:54.879701 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4d30e9fe-327f-41d2-a8fe-a7a9c11d1b3c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:54.887801 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4d30e9fe-327f-41d2-a8fe-a7a9c11d1b3c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:54.888428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4d30e9fe-327f-41d2-a8fe-a7a9c11d1b3c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:54.889786 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4d30e9fe-327f-41d2-a8fe-a7a9c11d1b3c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:54.890548 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4d30e9fe-327f-41d2-a8fe-a7a9c11d1b3c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:55.081553 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4d30e9fe-327f-41d2-a8fe-a7a9c11d1b3c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:55.090290 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4d30e9fe-327f-41d2-a8fe-a7a9c11d1b3c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.215451 Jun 16 16:13:55.090895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 101/227] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:54 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:56.110280 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e603d891-e634-4f2f-822c-923c90a3b831 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:56.111220 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e603d891-e634-4f2f-822c-923c90a3b831 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:56.117566 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e603d891-e634-4f2f-822c-923c90a3b831 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:56.118123 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e603d891-e634-4f2f-822c-923c90a3b831 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:56.119704 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e603d891-e634-4f2f-822c-923c90a3b831 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:56.120145 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e603d891-e634-4f2f-822c-923c90a3b831 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:56.254638 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=91 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:56.297490 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e603d891-e634-4f2f-822c-923c90a3b831 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:56.311366 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e603d891-e634-4f2f-822c-923c90a3b831 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.205116 Jun 16 16:13:56.312839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 102/228] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:56 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:57.335584 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-78c30f90-5f1f-48d3-8edd-d304224ed212 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:57.336548 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-78c30f90-5f1f-48d3-8edd-d304224ed212 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:57.344278 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-78c30f90-5f1f-48d3-8edd-d304224ed212 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:57.344733 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-78c30f90-5f1f-48d3-8edd-d304224ed212 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:57.345555 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-78c30f90-5f1f-48d3-8edd-d304224ed212 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:57.346038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-78c30f90-5f1f-48d3-8edd-d304224ed212 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:57.538101 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-78c30f90-5f1f-48d3-8edd-d304224ed212 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:57.549104 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-78c30f90-5f1f-48d3-8edd-d304224ed212 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.218701 Jun 16 16:13:57.549688 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 103/229] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:57 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:58.573503 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-0ab97aaf-ed17-49a8-8871-683190db7b04 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:58.574474 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-0ab97aaf-ed17-49a8-8871-683190db7b04 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:58.582033 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0ab97aaf-ed17-49a8-8871-683190db7b04 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:58.582492 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0ab97aaf-ed17-49a8-8871-683190db7b04 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:58.583339 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0ab97aaf-ed17-49a8-8871-683190db7b04 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:58.583770 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0ab97aaf-ed17-49a8-8871-683190db7b04 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:58.745551 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-0ab97aaf-ed17-49a8-8871-683190db7b04 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:58.755027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-0ab97aaf-ed17-49a8-8871-683190db7b04 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.186176 Jun 16 16:13:58.755692 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 104/230] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:58 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:59.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3ce2b4e6-6a6f-4de2-b19a-386b6e8f4fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:59.782895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3ce2b4e6-6a6f-4de2-b19a-386b6e8f4fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:59.791557 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3ce2b4e6-6a6f-4de2-b19a-386b6e8f4fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:59.793282 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3ce2b4e6-6a6f-4de2-b19a-386b6e8f4fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:59.793398 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3ce2b4e6-6a6f-4de2-b19a-386b6e8f4fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:59.793835 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3ce2b4e6-6a6f-4de2-b19a-386b6e8f4fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:59.970802 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3ce2b4e6-6a6f-4de2-b19a-386b6e8f4fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:59.979192 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3ce2b4e6-6a6f-4de2-b19a-386b6e8f4fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.203327 Jun 16 16:13:59.979903 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 105/231] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:59 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:00.407637 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=25 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:00.999441 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-07176342-dd81-4c3f-96db-2ff715d1b1b5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:01.000243 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-07176342-dd81-4c3f-96db-2ff715d1b1b5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:01.011718 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-07176342-dd81-4c3f-96db-2ff715d1b1b5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:01.012187 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-07176342-dd81-4c3f-96db-2ff715d1b1b5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:01.013173 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-07176342-dd81-4c3f-96db-2ff715d1b1b5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:01.013609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-07176342-dd81-4c3f-96db-2ff715d1b1b5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:01.198600 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-07176342-dd81-4c3f-96db-2ff715d1b1b5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:01.208058 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-07176342-dd81-4c3f-96db-2ff715d1b1b5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.214563 Jun 16 16:14:01.209028 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 106/232] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:00 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:02.234829 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6c39b774-0d84-4683-b408-bd5be74229d2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:02.235965 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6c39b774-0d84-4683-b408-bd5be74229d2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:02.248589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6c39b774-0d84-4683-b408-bd5be74229d2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:02.249406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6c39b774-0d84-4683-b408-bd5be74229d2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:02.250839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6c39b774-0d84-4683-b408-bd5be74229d2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:02.251611 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6c39b774-0d84-4683-b408-bd5be74229d2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:02.462247 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6c39b774-0d84-4683-b408-bd5be74229d2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:02.475681 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6c39b774-0d84-4683-b408-bd5be74229d2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.247120 Jun 16 16:14:02.477051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 107/233] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:02 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:03.278270 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] validate_networks() for [('77dab802-ad52-413c-bd18-780c89736c99', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:14:03.506073 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e1896b56-1780-454f-b385-c4585382fd61 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:03.510345 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e1896b56-1780-454f-b385-c4585382fd61 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:03.525657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1896b56-1780-454f-b385-c4585382fd61 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:03.526420 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1896b56-1780-454f-b385-c4585382fd61 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:03.529654 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1896b56-1780-454f-b385-c4585382fd61 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:03.531415 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1896b56-1780-454f-b385-c4585382fd61 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:03.765481 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e1896b56-1780-454f-b385-c4585382fd61 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:03.782311 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e1896b56-1780-454f-b385-c4585382fd61 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.287846 Jun 16 16:14:03.783031 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 108/234] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:03 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:03.827819 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:14:03.828256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:14:03.828825 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:14:03.829352 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:14:03.830361 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:14:03.843216 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:03.843945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:03.844937 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:03.845539 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:03.875897 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Getting quotas for project 7b4ba60390dd4354b869bb227ef030b6. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:14:03.880591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Getting quotas for user 246ac84c69894c08b870c4579cabd042 and project 7b4ba60390dd4354b869bb227ef030b6. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:14:03.896395 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:14:03.898873 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:14:03.972768 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8d72579e-2e9c-4374-8d02-3349c662976c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.583854 Jun 16 16:14:03.980166 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 127/235] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:13:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 13586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:14:03.985667 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e94b6845-5a74-4a7d-b5a3-d7b14c72b3ba tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:03.986460 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e94b6845-5a74-4a7d-b5a3-d7b14c72b3ba tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:04.064713 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e94b6845-5a74-4a7d-b5a3-d7b14c72b3ba tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:04.076445 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e94b6845-5a74-4a7d-b5a3-d7b14c72b3ba tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1213 microversion: 2.1 time: 0.094287 Jun 16 16:14:04.082070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 109/236] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:03 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:04.807620 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f1c8f8fa-5825-4a2c-86d9-53c4a5369e35 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:04.809553 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f1c8f8fa-5825-4a2c-86d9-53c4a5369e35 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:04.817162 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f1c8f8fa-5825-4a2c-86d9-53c4a5369e35 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:04.817873 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f1c8f8fa-5825-4a2c-86d9-53c4a5369e35 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:04.818824 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f1c8f8fa-5825-4a2c-86d9-53c4a5369e35 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:04.819679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f1c8f8fa-5825-4a2c-86d9-53c4a5369e35 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:05.042853 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f1c8f8fa-5825-4a2c-86d9-53c4a5369e35 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:05.052729 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f1c8f8fa-5825-4a2c-86d9-53c4a5369e35 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.252996 Jun 16 16:14:05.053770 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 128/237] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:04 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:05.102498 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-15b17222-60ea-4cff-abc3-1427fd08e6ff tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:05.103891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-15b17222-60ea-4cff-abc3-1427fd08e6ff tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:05.106475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=40 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:05.113919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-15b17222-60ea-4cff-abc3-1427fd08e6ff tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:05.114450 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-15b17222-60ea-4cff-abc3-1427fd08e6ff tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:05.115293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-15b17222-60ea-4cff-abc3-1427fd08e6ff tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:05.115771 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-15b17222-60ea-4cff-abc3-1427fd08e6ff tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:05.203272 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-15b17222-60ea-4cff-abc3-1427fd08e6ff tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:05.220067 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-15b17222-60ea-4cff-abc3-1427fd08e6ff tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1265 microversion: 2.1 time: 0.121273 Jun 16 16:14:05.221038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 110/238] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:05 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1265 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:06.080269 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2745cbde-b83e-45c3-8c28-1c9cf65179e4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:06.081100 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2745cbde-b83e-45c3-8c28-1c9cf65179e4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:06.093675 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2745cbde-b83e-45c3-8c28-1c9cf65179e4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:06.094578 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2745cbde-b83e-45c3-8c28-1c9cf65179e4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:06.096160 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2745cbde-b83e-45c3-8c28-1c9cf65179e4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:06.097347 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2745cbde-b83e-45c3-8c28-1c9cf65179e4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:06.241535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-667c3309-903d-4eb0-8839-5109d7284305 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:06.243103 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-667c3309-903d-4eb0-8839-5109d7284305 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:06.253486 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-667c3309-903d-4eb0-8839-5109d7284305 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:06.253975 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-667c3309-903d-4eb0-8839-5109d7284305 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:06.254809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-667c3309-903d-4eb0-8839-5109d7284305 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:06.255404 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-667c3309-903d-4eb0-8839-5109d7284305 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:06.414685 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-667c3309-903d-4eb0-8839-5109d7284305 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:06.429641 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-667c3309-903d-4eb0-8839-5109d7284305 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1283 microversion: 2.1 time: 0.193130 Jun 16 16:14:06.430535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 111/239] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:06 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1283 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:06.480554 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2745cbde-b83e-45c3-8c28-1c9cf65179e4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:06.491516 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2745cbde-b83e-45c3-8c28-1c9cf65179e4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1522 microversion: 2.1 time: 0.415782 Jun 16 16:14:06.492670 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 129/240] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:06 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:07.457211 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-76761036-318e-42a8-8af8-4f53532822fc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:07.458190 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-76761036-318e-42a8-8af8-4f53532822fc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:07.468260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-76761036-318e-42a8-8af8-4f53532822fc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:07.468998 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-76761036-318e-42a8-8af8-4f53532822fc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:07.470434 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-76761036-318e-42a8-8af8-4f53532822fc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:07.471144 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-76761036-318e-42a8-8af8-4f53532822fc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:07.515203 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e3ae1b60-75bd-439f-b6d3-6771b4740fb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:07.516585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e3ae1b60-75bd-439f-b6d3-6771b4740fb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:07.530433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e3ae1b60-75bd-439f-b6d3-6771b4740fb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:07.531866 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e3ae1b60-75bd-439f-b6d3-6771b4740fb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:07.533819 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e3ae1b60-75bd-439f-b6d3-6771b4740fb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:07.535184 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e3ae1b60-75bd-439f-b6d3-6771b4740fb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:07.724500 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-76761036-318e-42a8-8af8-4f53532822fc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:07.735301 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-76761036-318e-42a8-8af8-4f53532822fc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1313 microversion: 2.1 time: 0.285339 Jun 16 16:14:07.735890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 112/241] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:07 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:07.970121 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e3ae1b60-75bd-439f-b6d3-6771b4740fb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:07.983115 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e3ae1b60-75bd-439f-b6d3-6771b4740fb8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1502 microversion: 2.1 time: 0.474686 Jun 16 16:14:07.994409 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 130/242] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:07 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1502 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:08.011202 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-93a94e0d-ff0b-4806-bf6d-47293dd76f12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:08.012670 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-93a94e0d-ff0b-4806-bf6d-47293dd76f12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:08.023539 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-93a94e0d-ff0b-4806-bf6d-47293dd76f12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:08.024304 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-93a94e0d-ff0b-4806-bf6d-47293dd76f12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:08.025682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-93a94e0d-ff0b-4806-bf6d-47293dd76f12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:08.026372 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-93a94e0d-ff0b-4806-bf6d-47293dd76f12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:08.297755 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-93a94e0d-ff0b-4806-bf6d-47293dd76f12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:08.307075 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-93a94e0d-ff0b-4806-bf6d-47293dd76f12 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1514 microversion: 2.1 time: 0.301841 Jun 16 16:14:08.307794 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 113/243] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:08 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1514 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:08.641407 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-891a0037-7b80-48f4-b6a9-92e96951a03e req-e7a1bba5-00ea-462c-bf86-0fb5e141d989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d056427f-ea1e-4d7c-ad38-c4246623fabe", "tag": "dd5aa05d-7f92-4a94-bf64-854ee81ae609"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:08.653275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-891a0037-7b80-48f4-b6a9-92e96951a03e req-e7a1bba5-00ea-462c-bf86-0fb5e141d989 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:08.653718 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-891a0037-7b80-48f4-b6a9-92e96951a03e req-e7a1bba5-00ea-462c-bf86-0fb5e141d989 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:08.674312 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-891a0037-7b80-48f4-b6a9-92e96951a03e req-e7a1bba5-00ea-462c-bf86-0fb5e141d989 service nova] Creating event network-changed:dd5aa05d-7f92-4a94-bf64-854ee81ae609 for instance d056427f-ea1e-4d7c-ad38-c4246623fabe on hv-cinder-83716 Jun 16 16:14:08.688456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-891a0037-7b80-48f4-b6a9-92e96951a03e req-e7a1bba5-00ea-462c-bf86-0fb5e141d989 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052060 Jun 16 16:14:08.690952 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 131/244] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:08.759246 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-9dedfb8b-3e61-4046-8621-fb4c4bf7e05c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:08.760177 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-9dedfb8b-3e61-4046-8621-fb4c4bf7e05c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:08.772042 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9dedfb8b-3e61-4046-8621-fb4c4bf7e05c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:08.773419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9dedfb8b-3e61-4046-8621-fb4c4bf7e05c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:08.774952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9dedfb8b-3e61-4046-8621-fb4c4bf7e05c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:08.775668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9dedfb8b-3e61-4046-8621-fb4c4bf7e05c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:09.081533 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-9dedfb8b-3e61-4046-8621-fb4c4bf7e05c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:09.093140 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-9dedfb8b-3e61-4046-8621-fb4c4bf7e05c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1313 microversion: 2.1 time: 0.342051 Jun 16 16:14:09.094099 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 114/245] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:08 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:10.061364 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d5570385-58bd-4911-8f0f-7d0c6adb60e0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:10.063871 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d5570385-58bd-4911-8f0f-7d0c6adb60e0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:10.080206 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d5570385-58bd-4911-8f0f-7d0c6adb60e0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:10.080839 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d5570385-58bd-4911-8f0f-7d0c6adb60e0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:10.082156 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d5570385-58bd-4911-8f0f-7d0c6adb60e0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:10.083341 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d5570385-58bd-4911-8f0f-7d0c6adb60e0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:10.113535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4bf38d96-d027-4377-86c1-2a7ac4b4d8a8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:10.115202 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4bf38d96-d027-4377-86c1-2a7ac4b4d8a8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:10.136563 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4bf38d96-d027-4377-86c1-2a7ac4b4d8a8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:10.137440 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4bf38d96-d027-4377-86c1-2a7ac4b4d8a8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:10.138454 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4bf38d96-d027-4377-86c1-2a7ac4b4d8a8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:10.139127 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4bf38d96-d027-4377-86c1-2a7ac4b4d8a8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:10.143509 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-d5570385-58bd-4911-8f0f-7d0c6adb60e0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lazy-loading 'flavor' on Instance uuid 83df7777-6291-4644-a893-e1359c012b9f {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:14:10.164506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=100 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:10.248846 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d5570385-58bd-4911-8f0f-7d0c6adb60e0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "POST /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f/action" status: 200 len: 32 microversion: 2.1 time: 0.199547 Jun 16 16:14:10.249700 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 132/246] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 16:14:10 2022] POST /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f/action => generated 32 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:14:10.260878 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-357b7c5b-a471-4f72-8d27-3c59dabfca0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:10.261635 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-357b7c5b-a471-4f72-8d27-3c59dabfca0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:10.268714 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-357b7c5b-a471-4f72-8d27-3c59dabfca0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:10.269166 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-357b7c5b-a471-4f72-8d27-3c59dabfca0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:10.269961 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-357b7c5b-a471-4f72-8d27-3c59dabfca0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:10.270403 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-357b7c5b-a471-4f72-8d27-3c59dabfca0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:10.323349 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4bf38d96-d027-4377-86c1-2a7ac4b4d8a8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:10.337047 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4bf38d96-d027-4377-86c1-2a7ac4b4d8a8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1313 microversion: 2.1 time: 0.228177 Jun 16 16:14:10.342303 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 115/247] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:10 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:10.498181 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-357b7c5b-a471-4f72-8d27-3c59dabfca0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:10.507719 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-357b7c5b-a471-4f72-8d27-3c59dabfca0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.252224 Jun 16 16:14:10.508339 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 133/248] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:10 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:11.380508 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-5a5caae7-f7aa-47e1-a94c-3107580d1bd8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:11.382859 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-5a5caae7-f7aa-47e1-a94c-3107580d1bd8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:11.403572 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5a5caae7-f7aa-47e1-a94c-3107580d1bd8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:11.404797 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5a5caae7-f7aa-47e1-a94c-3107580d1bd8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:11.406596 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5a5caae7-f7aa-47e1-a94c-3107580d1bd8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:11.407812 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5a5caae7-f7aa-47e1-a94c-3107580d1bd8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:11.528176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7a694c77-02fd-42b6-b0af-f68e4e62437c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:11.529627 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7a694c77-02fd-42b6-b0af-f68e4e62437c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:11.539074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a694c77-02fd-42b6-b0af-f68e4e62437c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:11.541039 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a694c77-02fd-42b6-b0af-f68e4e62437c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:11.543148 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a694c77-02fd-42b6-b0af-f68e4e62437c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:11.544496 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7a694c77-02fd-42b6-b0af-f68e4e62437c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:11.828308 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5a5caae7-f7aa-47e1-a94c-3107580d1bd8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:11.838796 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-5a5caae7-f7aa-47e1-a94c-3107580d1bd8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1313 microversion: 2.1 time: 0.474693 Jun 16 16:14:11.849471 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 116/249] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:11 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:11.860906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7a694c77-02fd-42b6-b0af-f68e4e62437c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:11.881379 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7a694c77-02fd-42b6-b0af-f68e4e62437c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.355538 Jun 16 16:14:11.882923 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 134/250] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:11 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:12.860141 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7b36f4d4-0179-407b-ab51-f434c224d938 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:12.863407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7b36f4d4-0179-407b-ab51-f434c224d938 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:12.880155 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7b36f4d4-0179-407b-ab51-f434c224d938 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:12.880736 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7b36f4d4-0179-407b-ab51-f434c224d938 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:12.881613 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7b36f4d4-0179-407b-ab51-f434c224d938 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:12.882177 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7b36f4d4-0179-407b-ab51-f434c224d938 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:12.928266 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e189a3b7-bcab-4a4f-9223-9ab0023824f4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:12.929024 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e189a3b7-bcab-4a4f-9223-9ab0023824f4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:12.939922 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e189a3b7-bcab-4a4f-9223-9ab0023824f4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:12.940551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e189a3b7-bcab-4a4f-9223-9ab0023824f4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:12.941696 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e189a3b7-bcab-4a4f-9223-9ab0023824f4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:12.942325 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e189a3b7-bcab-4a4f-9223-9ab0023824f4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:13.085713 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7b36f4d4-0179-407b-ab51-f434c224d938 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:13.099572 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7b36f4d4-0179-407b-ab51-f434c224d938 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1313 microversion: 2.1 time: 0.245512 Jun 16 16:14:13.100454 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 117/251] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:12 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:13.172020 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e189a3b7-bcab-4a4f-9223-9ab0023824f4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:13.180704 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e189a3b7-bcab-4a4f-9223-9ab0023824f4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.257179 Jun 16 16:14:13.181371 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 135/252] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:12 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:14.120048 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-6fef6930-14ec-485c-8c16-b26595997b86 req-c15b913a-6ae3-45b0-b7c5-0c80bc6c0eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d056427f-ea1e-4d7c-ad38-c4246623fabe", "name": "network-vif-plugged", "status": "completed", "tag": "dd5aa05d-7f92-4a94-bf64-854ee81ae609"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:14.122927 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-10ba4e77-29c8-40c4-8bc7-a37f9aca853c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:14.124359 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-10ba4e77-29c8-40c4-8bc7-a37f9aca853c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:14.125377 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:14.136688 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=2 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:14.138423 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-6fef6930-14ec-485c-8c16-b26595997b86 req-c15b913a-6ae3-45b0-b7c5-0c80bc6c0eae service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:14.139202 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=6 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:14.139453 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-6fef6930-14ec-485c-8c16-b26595997b86 req-c15b913a-6ae3-45b0-b7c5-0c80bc6c0eae service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:14.143609 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-10ba4e77-29c8-40c4-8bc7-a37f9aca853c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:14.145854 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-10ba4e77-29c8-40c4-8bc7-a37f9aca853c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:14.147582 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-10ba4e77-29c8-40c4-8bc7-a37f9aca853c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:14.150437 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-10ba4e77-29c8-40c4-8bc7-a37f9aca853c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:14.181057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-6fef6930-14ec-485c-8c16-b26595997b86 req-c15b913a-6ae3-45b0-b7c5-0c80bc6c0eae service nova] Creating event network-vif-plugged:dd5aa05d-7f92-4a94-bf64-854ee81ae609 for instance d056427f-ea1e-4d7c-ad38-c4246623fabe on hv-cinder-83716 Jun 16 16:14:14.206637 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-6fef6930-14ec-485c-8c16-b26595997b86 req-c15b913a-6ae3-45b0-b7c5-0c80bc6c0eae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098001 Jun 16 16:14:14.208440 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 118/253] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:14.218342 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d76bb446-347f-480e-b186-082c1767cad6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:14.219055 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d76bb446-347f-480e-b186-082c1767cad6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:14.227284 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d76bb446-347f-480e-b186-082c1767cad6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:14.227770 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d76bb446-347f-480e-b186-082c1767cad6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:14.228784 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d76bb446-347f-480e-b186-082c1767cad6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:14.229440 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d76bb446-347f-480e-b186-082c1767cad6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:14.381511 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-10ba4e77-29c8-40c4-8bc7-a37f9aca853c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:14.394393 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-10ba4e77-29c8-40c4-8bc7-a37f9aca853c tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1313 microversion: 2.1 time: 0.276206 Jun 16 16:14:14.395111 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 136/254] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:14 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:14.427299 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d76bb446-347f-480e-b186-082c1767cad6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:14.443117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d76bb446-347f-480e-b186-082c1767cad6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.231855 Jun 16 16:14:14.444185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 119/255] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:14 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:15.420919 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f7da36c6-bb00-4d54-a750-a6cd6ca279a5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:15.421574 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f7da36c6-bb00-4d54-a750-a6cd6ca279a5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:15.429227 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7da36c6-bb00-4d54-a750-a6cd6ca279a5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:15.429830 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7da36c6-bb00-4d54-a750-a6cd6ca279a5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:15.430992 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7da36c6-bb00-4d54-a750-a6cd6ca279a5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:15.431965 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7da36c6-bb00-4d54-a750-a6cd6ca279a5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:15.472968 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-40b2de61-1b20-4f58-9fd4-7eb90821bb20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:15.473680 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-40b2de61-1b20-4f58-9fd4-7eb90821bb20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:15.488857 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-40b2de61-1b20-4f58-9fd4-7eb90821bb20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:15.489309 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-40b2de61-1b20-4f58-9fd4-7eb90821bb20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:15.490121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-40b2de61-1b20-4f58-9fd4-7eb90821bb20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:15.490554 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-40b2de61-1b20-4f58-9fd4-7eb90821bb20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:15.621044 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f7da36c6-bb00-4d54-a750-a6cd6ca279a5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:15.629147 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f7da36c6-bb00-4d54-a750-a6cd6ca279a5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1313 microversion: 2.1 time: 0.212037 Jun 16 16:14:15.630027 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 137/256] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:15 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:15.655695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-40b2de61-1b20-4f58-9fd4-7eb90821bb20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:15.663651 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-40b2de61-1b20-4f58-9fd4-7eb90821bb20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.196488 Jun 16 16:14:15.664872 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 120/257] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:15 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:16.650738 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d4cd2854-f078-4df3-8c5c-778446a13bbc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:16.651560 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d4cd2854-f078-4df3-8c5c-778446a13bbc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:16.660033 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4cd2854-f078-4df3-8c5c-778446a13bbc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:16.660578 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4cd2854-f078-4df3-8c5c-778446a13bbc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:16.661479 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4cd2854-f078-4df3-8c5c-778446a13bbc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:16.662019 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4cd2854-f078-4df3-8c5c-778446a13bbc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:16.683447 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-721e0361-5e58-4a82-bf49-fa92bcbe296b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:16.684415 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-721e0361-5e58-4a82-bf49-fa92bcbe296b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:16.692043 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-721e0361-5e58-4a82-bf49-fa92bcbe296b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:16.692736 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-721e0361-5e58-4a82-bf49-fa92bcbe296b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:16.693692 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-721e0361-5e58-4a82-bf49-fa92bcbe296b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:16.694261 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-721e0361-5e58-4a82-bf49-fa92bcbe296b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:16.831890 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d4cd2854-f078-4df3-8c5c-778446a13bbc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:16.846209 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d4cd2854-f078-4df3-8c5c-778446a13bbc tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1313 microversion: 2.1 time: 0.200790 Jun 16 16:14:16.847719 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 138/258] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:16 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:16.882882 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-721e0361-5e58-4a82-bf49-fa92bcbe296b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:16.895317 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-721e0361-5e58-4a82-bf49-fa92bcbe296b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.216527 Jun 16 16:14:16.895897 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 121/259] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:16 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:17.869167 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0db83971-2e37-4155-8549-5294f7b7cc47 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:17.871181 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0db83971-2e37-4155-8549-5294f7b7cc47 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:17.882324 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0db83971-2e37-4155-8549-5294f7b7cc47 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:17.883377 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0db83971-2e37-4155-8549-5294f7b7cc47 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:17.885773 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0db83971-2e37-4155-8549-5294f7b7cc47 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:17.887010 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0db83971-2e37-4155-8549-5294f7b7cc47 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:17.920021 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d291c226-a58b-4f21-9343-c342deabfda8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:17.922051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d291c226-a58b-4f21-9343-c342deabfda8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:17.942253 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d291c226-a58b-4f21-9343-c342deabfda8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:17.942253 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d291c226-a58b-4f21-9343-c342deabfda8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:17.942253 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d291c226-a58b-4f21-9343-c342deabfda8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:17.942253 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d291c226-a58b-4f21-9343-c342deabfda8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:18.274153 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d291c226-a58b-4f21-9343-c342deabfda8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:18.309150 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d291c226-a58b-4f21-9343-c342deabfda8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.394827 Jun 16 16:14:18.318093 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 122/260] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:17 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:18.631132 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0db83971-2e37-4155-8549-5294f7b7cc47 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:18.642795 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0db83971-2e37-4155-8549-5294f7b7cc47 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1313 microversion: 2.1 time: 0.779037 Jun 16 16:14:18.646917 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 139/261] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:17 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1313 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:18.956641 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-64909679-e3fc-49ad-8d68-1714cb9cc585 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:18.957528 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-64909679-e3fc-49ad-8d68-1714cb9cc585 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:18.969175 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-64909679-e3fc-49ad-8d68-1714cb9cc585 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:18.969875 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-64909679-e3fc-49ad-8d68-1714cb9cc585 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:18.971169 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-64909679-e3fc-49ad-8d68-1714cb9cc585 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:18.971919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-64909679-e3fc-49ad-8d68-1714cb9cc585 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:19.013313 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-64909679-e3fc-49ad-8d68-1714cb9cc585 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/ips" status: 200 len: 149 microversion: 2.1 time: 0.063801 Jun 16 16:14:19.014965 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 123/262] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 16:14:18 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/ips => generated 149 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:19.345599 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-db8f1ff5-f3ed-41b9-a01b-1d3e8ec95661 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:19.345599 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-db8f1ff5-f3ed-41b9-a01b-1d3e8ec95661 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:19.360437 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db8f1ff5-f3ed-41b9-a01b-1d3e8ec95661 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:19.361234 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db8f1ff5-f3ed-41b9-a01b-1d3e8ec95661 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:19.362554 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db8f1ff5-f3ed-41b9-a01b-1d3e8ec95661 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:19.363544 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db8f1ff5-f3ed-41b9-a01b-1d3e8ec95661 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:19.647478 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-db8f1ff5-f3ed-41b9-a01b-1d3e8ec95661 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:19.661363 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-db8f1ff5-f3ed-41b9-a01b-1d3e8ec95661 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.321358 Jun 16 16:14:19.662574 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 140/263] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:19 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:19.675159 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-cd0f3891-4499-4817-b119-0596388ba5e6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:19.676229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-cd0f3891-4499-4817-b119-0596388ba5e6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:19.687058 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cd0f3891-4499-4817-b119-0596388ba5e6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:19.688329 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cd0f3891-4499-4817-b119-0596388ba5e6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:19.689870 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cd0f3891-4499-4817-b119-0596388ba5e6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:19.690642 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cd0f3891-4499-4817-b119-0596388ba5e6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:19.938902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-cd0f3891-4499-4817-b119-0596388ba5e6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:19.950447 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-cd0f3891-4499-4817-b119-0596388ba5e6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1313 microversion: 2.1 time: 0.282262 Jun 16 16:14:19.951397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 124/264] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:19 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:20.692183 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-360e1290-69b7-4a78-9d1f-5691eb6ca625 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:20.693180 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-360e1290-69b7-4a78-9d1f-5691eb6ca625 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:20.703071 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-360e1290-69b7-4a78-9d1f-5691eb6ca625 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:20.703841 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-360e1290-69b7-4a78-9d1f-5691eb6ca625 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:20.705239 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-360e1290-69b7-4a78-9d1f-5691eb6ca625 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:20.705876 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-360e1290-69b7-4a78-9d1f-5691eb6ca625 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:20.891725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-360e1290-69b7-4a78-9d1f-5691eb6ca625 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:20.902282 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-360e1290-69b7-4a78-9d1f-5691eb6ca625 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.216588 Jun 16 16:14:20.903258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 141/265] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:20 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:20.974355 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a98fe210-02ac-48a3-9406-6a45173a60cb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:20.975002 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a98fe210-02ac-48a3-9406-6a45173a60cb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:20.982083 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a98fe210-02ac-48a3-9406-6a45173a60cb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:20.982536 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a98fe210-02ac-48a3-9406-6a45173a60cb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:20.983320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a98fe210-02ac-48a3-9406-6a45173a60cb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:20.983752 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a98fe210-02ac-48a3-9406-6a45173a60cb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:21.160825 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a98fe210-02ac-48a3-9406-6a45173a60cb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:21.173451 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a98fe210-02ac-48a3-9406-6a45173a60cb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1313 microversion: 2.1 time: 0.204139 Jun 16 16:14:21.174405 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 125/266] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:20 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:21.922904 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9e55805c-4036-4e61-ae10-a7f5ee7d39b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:21.923849 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9e55805c-4036-4e61-ae10-a7f5ee7d39b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:21.934019 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9e55805c-4036-4e61-ae10-a7f5ee7d39b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:21.934475 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9e55805c-4036-4e61-ae10-a7f5ee7d39b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:21.935264 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9e55805c-4036-4e61-ae10-a7f5ee7d39b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:21.935703 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9e55805c-4036-4e61-ae10-a7f5ee7d39b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:22.098509 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9e55805c-4036-4e61-ae10-a7f5ee7d39b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:22.104044 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:22.109747 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9e55805c-4036-4e61-ae10-a7f5ee7d39b0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.193089 Jun 16 16:14:22.110361 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 142/267] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:21 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:22.200116 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ec3d7b90-824a-4d8a-b234-96fd12d2c9e3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:22.201190 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ec3d7b90-824a-4d8a-b234-96fd12d2c9e3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:22.211614 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ec3d7b90-824a-4d8a-b234-96fd12d2c9e3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:22.212678 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ec3d7b90-824a-4d8a-b234-96fd12d2c9e3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:22.214044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ec3d7b90-824a-4d8a-b234-96fd12d2c9e3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:22.214491 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ec3d7b90-824a-4d8a-b234-96fd12d2c9e3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:22.399799 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ec3d7b90-824a-4d8a-b234-96fd12d2c9e3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:22.408100 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ec3d7b90-824a-4d8a-b234-96fd12d2c9e3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1313 microversion: 2.1 time: 0.214921 Jun 16 16:14:22.408698 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 126/268] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:22 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:23.134618 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a3b1e347-d01d-48c1-a657-883a43af8f3f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:23.143842 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a3b1e347-d01d-48c1-a657-883a43af8f3f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:23.163731 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a3b1e347-d01d-48c1-a657-883a43af8f3f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:23.165001 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a3b1e347-d01d-48c1-a657-883a43af8f3f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:23.167541 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a3b1e347-d01d-48c1-a657-883a43af8f3f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:23.168212 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a3b1e347-d01d-48c1-a657-883a43af8f3f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:23.391545 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a3b1e347-d01d-48c1-a657-883a43af8f3f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:23.403255 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a3b1e347-d01d-48c1-a657-883a43af8f3f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.276854 Jun 16 16:14:23.404297 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 143/269] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:23 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:23.427436 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-2dd47851-5107-45f4-9dbd-b2d6e14bd04a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:23.428293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2dd47851-5107-45f4-9dbd-b2d6e14bd04a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:23.436345 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2dd47851-5107-45f4-9dbd-b2d6e14bd04a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:23.437039 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2dd47851-5107-45f4-9dbd-b2d6e14bd04a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:23.438205 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2dd47851-5107-45f4-9dbd-b2d6e14bd04a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:23.438761 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2dd47851-5107-45f4-9dbd-b2d6e14bd04a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:23.700908 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-2dd47851-5107-45f4-9dbd-b2d6e14bd04a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:23.717638 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-2dd47851-5107-45f4-9dbd-b2d6e14bd04a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1498 microversion: 2.1 time: 0.293291 Jun 16 16:14:23.717638 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 127/270] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:23 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1498 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:24.427506 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-275505ec-f2ab-47b2-b424-9037f8a36fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:24.428476 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-275505ec-f2ab-47b2-b424-9037f8a36fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:24.442178 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-275505ec-f2ab-47b2-b424-9037f8a36fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:24.442948 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-275505ec-f2ab-47b2-b424-9037f8a36fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:24.444326 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-275505ec-f2ab-47b2-b424-9037f8a36fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:24.445045 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-275505ec-f2ab-47b2-b424-9037f8a36fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:24.678620 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-275505ec-f2ab-47b2-b424-9037f8a36fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:24.690523 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-275505ec-f2ab-47b2-b424-9037f8a36fbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.267016 Jun 16 16:14:24.691768 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 144/271] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:24 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:25.716888 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d5b75118-e7aa-4089-a9e2-5145c16ce6be tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:25.717774 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d5b75118-e7aa-4089-a9e2-5145c16ce6be tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:25.727686 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5b75118-e7aa-4089-a9e2-5145c16ce6be tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:25.728736 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5b75118-e7aa-4089-a9e2-5145c16ce6be tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:25.729812 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5b75118-e7aa-4089-a9e2-5145c16ce6be tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:25.730380 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5b75118-e7aa-4089-a9e2-5145c16ce6be tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:25.973012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d5b75118-e7aa-4089-a9e2-5145c16ce6be tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:25.987767 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d5b75118-e7aa-4089-a9e2-5145c16ce6be tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.278095 Jun 16 16:14:25.988775 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 128/272] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:25 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:27.010773 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e2349dd6-be2f-4e60-86c5-f9a883923bba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:27.011570 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e2349dd6-be2f-4e60-86c5-f9a883923bba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:27.018728 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2349dd6-be2f-4e60-86c5-f9a883923bba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:27.019182 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2349dd6-be2f-4e60-86c5-f9a883923bba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:27.020007 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2349dd6-be2f-4e60-86c5-f9a883923bba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:27.020488 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2349dd6-be2f-4e60-86c5-f9a883923bba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:27.243420 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e2349dd6-be2f-4e60-86c5-f9a883923bba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:27.257756 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e2349dd6-be2f-4e60-86c5-f9a883923bba tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.251141 Jun 16 16:14:27.259986 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 145/273] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:27 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:28.289241 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5d9b20e5-48c0-4d65-8bb0-a5d85246dfce tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f368a239-bfb0-4b6e-93d7-47344909eb3a"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:28.290124 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-275ee710-a7de-4c73-80ed-5afe22cc63bc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:28.291038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-275ee710-a7de-4c73-80ed-5afe22cc63bc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:28.291252 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5d9b20e5-48c0-4d65-8bb0-a5d85246dfce tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:28.302110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d9b20e5-48c0-4d65-8bb0-a5d85246dfce tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:28.303155 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d9b20e5-48c0-4d65-8bb0-a5d85246dfce tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:28.303744 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-275ee710-a7de-4c73-80ed-5afe22cc63bc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:28.304534 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d9b20e5-48c0-4d65-8bb0-a5d85246dfce tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:28.304723 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-275ee710-a7de-4c73-80ed-5afe22cc63bc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:28.305334 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d9b20e5-48c0-4d65-8bb0-a5d85246dfce tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:28.306272 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-275ee710-a7de-4c73-80ed-5afe22cc63bc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:28.307329 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-275ee710-a7de-4c73-80ed-5afe22cc63bc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:28.599926 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-275ee710-a7de-4c73-80ed-5afe22cc63bc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:28.624310 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-275ee710-a7de-4c73-80ed-5afe22cc63bc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.346976 Jun 16 16:14:28.625208 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 129/274] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:28 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:28.636098 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6ef4d157-c12e-4c5b-a4d1-127862c0d40a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:28.637152 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6ef4d157-c12e-4c5b-a4d1-127862c0d40a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:28.657705 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ef4d157-c12e-4c5b-a4d1-127862c0d40a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:28.658699 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ef4d157-c12e-4c5b-a4d1-127862c0d40a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:28.659597 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ef4d157-c12e-4c5b-a4d1-127862c0d40a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:28.660044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ef4d157-c12e-4c5b-a4d1-127862c0d40a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:28.721680 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6ef4d157-c12e-4c5b-a4d1-127862c0d40a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Going to try to terminate instance {{(pid=117756) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:14:28.862970 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5d9b20e5-48c0-4d65-8bb0-a5d85246dfce tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "POST /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.581301 Jun 16 16:14:28.864059 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 146/275] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 16:14:28 2022] POST /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:14:28.903340 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6ef4d157-c12e-4c5b-a4d1-127862c0d40a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 204 len: 0 microversion: 2.1 time: 0.275970 Jun 16 16:14:28.904315 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 130/276] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:14:28 2022] DELETE /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:14:28.921469 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ca37b45c-ac15-4f2b-8afb-310f72ae1b7e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:28.922870 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ca37b45c-ac15-4f2b-8afb-310f72ae1b7e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:28.936832 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ca37b45c-ac15-4f2b-8afb-310f72ae1b7e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:28.937805 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ca37b45c-ac15-4f2b-8afb-310f72ae1b7e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:28.939293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ca37b45c-ac15-4f2b-8afb-310f72ae1b7e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:28.940266 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ca37b45c-ac15-4f2b-8afb-310f72ae1b7e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:29.203414 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ca37b45c-ac15-4f2b-8afb-310f72ae1b7e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:29.221659 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ca37b45c-ac15-4f2b-8afb-310f72ae1b7e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1504 microversion: 2.1 time: 0.309922 Jun 16 16:14:29.222699 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 147/277] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:28 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:29.654717 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6d04444c-eb17-4241-ac7e-c5e6bebe1541 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:29.656019 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6d04444c-eb17-4241-ac7e-c5e6bebe1541 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:29.667394 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6d04444c-eb17-4241-ac7e-c5e6bebe1541 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:29.667947 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6d04444c-eb17-4241-ac7e-c5e6bebe1541 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:29.669153 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6d04444c-eb17-4241-ac7e-c5e6bebe1541 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:29.669790 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6d04444c-eb17-4241-ac7e-c5e6bebe1541 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:29.700625 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:29.897013 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6d04444c-eb17-4241-ac7e-c5e6bebe1541 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:29.906967 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6d04444c-eb17-4241-ac7e-c5e6bebe1541 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.259016 Jun 16 16:14:29.908055 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 131/278] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:29 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:30.247984 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c2d38864-ce94-4ad3-970e-d60062bd48c5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:30.249303 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c2d38864-ce94-4ad3-970e-d60062bd48c5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:30.256472 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c2d38864-ce94-4ad3-970e-d60062bd48c5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:30.256956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c2d38864-ce94-4ad3-970e-d60062bd48c5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:30.258248 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c2d38864-ce94-4ad3-970e-d60062bd48c5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:30.259692 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c2d38864-ce94-4ad3-970e-d60062bd48c5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:30.486029 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c2d38864-ce94-4ad3-970e-d60062bd48c5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:30.497233 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c2d38864-ce94-4ad3-970e-d60062bd48c5 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1504 microversion: 2.1 time: 0.253879 Jun 16 16:14:30.498331 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 148/279] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:30 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:30.928890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-5d3940fb-a77b-4a45-b70f-7133eff819eb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:30.929751 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-5d3940fb-a77b-4a45-b70f-7133eff819eb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:30.947050 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5d3940fb-a77b-4a45-b70f-7133eff819eb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:30.947680 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5d3940fb-a77b-4a45-b70f-7133eff819eb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:30.949297 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5d3940fb-a77b-4a45-b70f-7133eff819eb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:30.949972 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5d3940fb-a77b-4a45-b70f-7133eff819eb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:31.280210 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5d3940fb-a77b-4a45-b70f-7133eff819eb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:31.296199 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-5d3940fb-a77b-4a45-b70f-7133eff819eb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.371014 Jun 16 16:14:31.298029 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 132/280] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:30 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:31.530084 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7350dc7e-a6a0-40f4-8bd2-e65b1ce8b72b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:31.534228 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7350dc7e-a6a0-40f4-8bd2-e65b1ce8b72b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:31.555807 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:31.558026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7350dc7e-a6a0-40f4-8bd2-e65b1ce8b72b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:31.558576 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7350dc7e-a6a0-40f4-8bd2-e65b1ce8b72b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:31.559551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7350dc7e-a6a0-40f4-8bd2-e65b1ce8b72b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:31.560569 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7350dc7e-a6a0-40f4-8bd2-e65b1ce8b72b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:31.909378 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7350dc7e-a6a0-40f4-8bd2-e65b1ce8b72b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:31.929909 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7350dc7e-a6a0-40f4-8bd2-e65b1ce8b72b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1504 microversion: 2.1 time: 0.408216 Jun 16 16:14:31.931894 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 149/281] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:31 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1504 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:32.331574 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-88c6fb2b-9ff8-46f9-84f5-8ad0cd7883f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:32.332670 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-88c6fb2b-9ff8-46f9-84f5-8ad0cd7883f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:32.383181 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-88c6fb2b-9ff8-46f9-84f5-8ad0cd7883f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:32.384365 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-88c6fb2b-9ff8-46f9-84f5-8ad0cd7883f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:32.385893 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-88c6fb2b-9ff8-46f9-84f5-8ad0cd7883f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:32.386746 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-88c6fb2b-9ff8-46f9-84f5-8ad0cd7883f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:32.533549 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-ee1cc378-4df4-40f6-9c83-1cbc1969b486 req-dfd37cb6-61ab-402a-bd71-48e65f719115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d056427f-ea1e-4d7c-ad38-c4246623fabe", "name": "network-vif-deleted", "tag": "dd5aa05d-7f92-4a94-bf64-854ee81ae609"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:32.571258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-ee1cc378-4df4-40f6-9c83-1cbc1969b486 req-dfd37cb6-61ab-402a-bd71-48e65f719115 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:32.573132 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-ee1cc378-4df4-40f6-9c83-1cbc1969b486 req-dfd37cb6-61ab-402a-bd71-48e65f719115 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:32.622881 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-ee1cc378-4df4-40f6-9c83-1cbc1969b486 req-dfd37cb6-61ab-402a-bd71-48e65f719115 service nova] Creating event network-vif-deleted:dd5aa05d-7f92-4a94-bf64-854ee81ae609 for instance d056427f-ea1e-4d7c-ad38-c4246623fabe on hv-cinder-83716 Jun 16 16:14:32.638522 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-ee1cc378-4df4-40f6-9c83-1cbc1969b486 req-dfd37cb6-61ab-402a-bd71-48e65f719115 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107067 Jun 16 16:14:32.643003 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 150/282] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:32.878007 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-88c6fb2b-9ff8-46f9-84f5-8ad0cd7883f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:32.906516 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-88c6fb2b-9ff8-46f9-84f5-8ad0cd7883f9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.593263 Jun 16 16:14:32.908092 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 133/283] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:32 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:32.961395 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-db1b235b-bc3a-4392-8f8c-3514f45d24fd tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:32.962982 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-db1b235b-bc3a-4392-8f8c-3514f45d24fd tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:33.006312 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db1b235b-bc3a-4392-8f8c-3514f45d24fd tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:33.006980 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db1b235b-bc3a-4392-8f8c-3514f45d24fd tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:33.008650 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db1b235b-bc3a-4392-8f8c-3514f45d24fd tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:33.009444 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db1b235b-bc3a-4392-8f8c-3514f45d24fd tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:33.104563 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db1b235b-bc3a-4392-8f8c-3514f45d24fd tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:33.105902 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db1b235b-bc3a-4392-8f8c-3514f45d24fd tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:33.106786 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-db1b235b-bc3a-4392-8f8c-3514f45d24fd tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lazy-loading 'fault' on Instance uuid d056427f-ea1e-4d7c-ad38-c4246623fabe {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:14:33.203852 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-db1b235b-bc3a-4392-8f8c-3514f45d24fd tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:33.219323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-db1b235b-bc3a-4392-8f8c-3514f45d24fd tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 200 len: 1303 microversion: 2.1 time: 0.264505 Jun 16 16:14:33.220343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 151/284] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:32 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 1303 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:33.943032 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-631407b3-2192-4e23-9efb-8afc32bdb814 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:33.943770 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-631407b3-2192-4e23-9efb-8afc32bdb814 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:33.955498 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-631407b3-2192-4e23-9efb-8afc32bdb814 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:33.955981 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-631407b3-2192-4e23-9efb-8afc32bdb814 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:33.956815 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-631407b3-2192-4e23-9efb-8afc32bdb814 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:33.957318 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-631407b3-2192-4e23-9efb-8afc32bdb814 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:34.251920 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-631407b3-2192-4e23-9efb-8afc32bdb814 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:34.252490 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f7e3982a-a42c-4ec6-a903-54cfb1d46a9d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:34.257169 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f7e3982a-a42c-4ec6-a903-54cfb1d46a9d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: d056427f-ea1e-4d7c-ad38-c4246623fabe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:34.278668 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7e3982a-a42c-4ec6-a903-54cfb1d46a9d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:34.279099 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7e3982a-a42c-4ec6-a903-54cfb1d46a9d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:34.279348 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-631407b3-2192-4e23-9efb-8afc32bdb814 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.340355 Jun 16 16:14:34.284896 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7e3982a-a42c-4ec6-a903-54cfb1d46a9d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:34.285652 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7e3982a-a42c-4ec6-a903-54cfb1d46a9d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:34.293421 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 134/285] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:33 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:34.336938 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-f7e3982a-a42c-4ec6-a903-54cfb1d46a9d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] HTTP exception thrown: Instance d056427f-ea1e-4d7c-ad38-c4246623fabe could not be found. Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f7e3982a-a42c-4ec6-a903-54cfb1d46a9d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Request method failure captured: Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe HTTP/1.1 Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1a6WNBJvkwpZwwtBx1AoadtL_VsFSyPCcMANUvP_Xk1NL_ct4DPy_-J_AOqJxGtqR9y2cXCA-jVN-bziIJT2Od5b-XrVZXOATSYSmBwKVGs2kOVF7t6OVT9Yl8-swv6x0spBGgs-UuLXsCRxJXUE6KnUWrcmOngnvqQuDMB66-nfcI Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 7b4ba60390dd4354b869bb227ef030b6 Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-VolumesActionsTest-1659229132 Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:14:34.338698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:14:34.340533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7b4ba60390dd4354b869bb227ef030b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b4ba60390dd4354b869bb227ef030b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7b4ba60390dd4354b869bb227ef030b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b4ba60390dd4354b869bb227ef030b6"}]}] Jun 16 16:14:34.340533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-VolumesActionsTest-1659229132 Jun 16 16:14:34.340533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 7b4ba60390dd4354b869bb227ef030b6 Jun 16 16:14:34.340533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-VolumesActionsTest-1659229132 Jun 16 16:14:34.340533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-VolumesActionsTest-1659229132-project Jun 16 16:14:34.340533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:14:34.340533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:14:34.340533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 246ac84c69894c08b870c4579cabd042 Jun 16 16:14:34.340533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-VolumesActionsTest-1659229132-project Jun 16 16:14:34.340533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:14:34.340533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance d056427f-ea1e-4d7c-ad38-c4246623fabe could not be found. Jun 16 16:14:34.340533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': 'd056427f-ea1e-4d7c-ad38-c4246623fabe'} Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d056427f-ea1e-4d7c-ad38-c4246623fabe could not be found. Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:14:34.341355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d056427f-ea1e-4d7c-ad38-c4246623fabe could not be found. Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d056427f-ea1e-4d7c-ad38-c4246623fabe could not be found. Jun 16 16:14:34.343536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:14:34.347167 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f7e3982a-a42c-4ec6-a903-54cfb1d46a9d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Returning 404 to user: Instance d056427f-ea1e-4d7c-ad38-c4246623fabe could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:14:34.348405 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f7e3982a-a42c-4ec6-a903-54cfb1d46a9d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe" status: 404 len: 111 microversion: 2.1 time: 0.110125 Jun 16 16:14:34.350214 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 152/286] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:34 2022] GET /compute/v2.1/servers/d056427f-ea1e-4d7c-ad38-c4246623fabe => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:14:34.620716 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-636952374", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "networks": [{"uuid": "77dab802-ad52-413c-bd18-780c89736c99"}]}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:34.802684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.network.neutron [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] validate_networks() for [('77dab802-ad52-413c-bd18-780c89736c99', None, None, None, None, None)] {{(pid=117756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:14:35.309658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e250fa9b-f31d-470b-bbd0-7be862e19e10 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:35.316311 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e250fa9b-f31d-470b-bbd0-7be862e19e10 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:35.326772 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e250fa9b-f31d-470b-bbd0-7be862e19e10 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:35.327394 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e250fa9b-f31d-470b-bbd0-7be862e19e10 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:35.328871 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e250fa9b-f31d-470b-bbd0-7be862e19e10 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:35.329702 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e250fa9b-f31d-470b-bbd0-7be862e19e10 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:35.605545 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e250fa9b-f31d-470b-bbd0-7be862e19e10 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:35.620009 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e250fa9b-f31d-470b-bbd0-7be862e19e10 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.318636 Jun 16 16:14:35.620737 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 153/287] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:35 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:35.889011 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Flavor limits 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:14:35.891140 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Image limits 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:14:35.892262 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Flavor pref 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:14:35.893319 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Image pref 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:14:35.894117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:14:35.902683 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:35.919019 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:35.920146 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:35.922250 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:35.923548 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:35.964561 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Getting quotas for project 7b4ba60390dd4354b869bb227ef030b6. Resources: {'instances', 'cores', 'ram'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:14:35.971827 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Getting quotas for user 246ac84c69894c08b870c4579cabd042 and project 7b4ba60390dd4354b869bb227ef030b6. Resources: {'instances', 'cores', 'ram'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:14:35.994921 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Going to run 1 instances... {{(pid=117756) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:14:35.999941 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:14:36.081051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a1b6a250-5ce3-45d9-909d-136538496bc8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.469291 Jun 16 16:14:36.082881 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 135/288] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:14:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:14:36.095436 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f8d20662-f7f8-4fac-b769-3841a5c5aaf8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:36.096470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f8d20662-f7f8-4fac-b769-3841a5c5aaf8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:36.225300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f8d20662-f7f8-4fac-b769-3841a5c5aaf8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:36.238708 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f8d20662-f7f8-4fac-b769-3841a5c5aaf8 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1213 microversion: 2.1 time: 0.148000 Jun 16 16:14:36.239590 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 154/289] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:36 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1213 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:36.648669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ac8ac24a-306b-4b5d-9221-eede727e79a5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:36.650355 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ac8ac24a-306b-4b5d-9221-eede727e79a5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:36.673090 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ac8ac24a-306b-4b5d-9221-eede727e79a5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:36.674544 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ac8ac24a-306b-4b5d-9221-eede727e79a5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:36.677973 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ac8ac24a-306b-4b5d-9221-eede727e79a5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:36.680858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ac8ac24a-306b-4b5d-9221-eede727e79a5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:37.216039 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ac8ac24a-306b-4b5d-9221-eede727e79a5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:37.227540 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ac8ac24a-306b-4b5d-9221-eede727e79a5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.586585 Jun 16 16:14:37.228305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 136/290] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:36 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:37.266470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ce381fc0-ea38-4e0c-abba-20e933502aa1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:37.268884 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ce381fc0-ea38-4e0c-abba-20e933502aa1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:37.280921 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce381fc0-ea38-4e0c-abba-20e933502aa1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:37.282210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce381fc0-ea38-4e0c-abba-20e933502aa1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:37.284099 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce381fc0-ea38-4e0c-abba-20e933502aa1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:37.285408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce381fc0-ea38-4e0c-abba-20e933502aa1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:37.448884 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ce381fc0-ea38-4e0c-abba-20e933502aa1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:37.470663 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ce381fc0-ea38-4e0c-abba-20e933502aa1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1217 microversion: 2.1 time: 0.215322 Jun 16 16:14:37.471783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 155/291] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:37 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:38.259350 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-2e0dca1a-3ce7-488d-969e-9b1c811efeee tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:38.261399 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2e0dca1a-3ce7-488d-969e-9b1c811efeee tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:38.276161 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2e0dca1a-3ce7-488d-969e-9b1c811efeee tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:38.276823 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2e0dca1a-3ce7-488d-969e-9b1c811efeee tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:38.278508 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2e0dca1a-3ce7-488d-969e-9b1c811efeee tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:38.279522 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2e0dca1a-3ce7-488d-969e-9b1c811efeee tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:38.506652 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-03996c0b-969a-4573-a9c6-e61e75674d0e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:38.509520 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-03996c0b-969a-4573-a9c6-e61e75674d0e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:38.520444 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-03996c0b-969a-4573-a9c6-e61e75674d0e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:38.521180 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-03996c0b-969a-4573-a9c6-e61e75674d0e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:38.522261 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-03996c0b-969a-4573-a9c6-e61e75674d0e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:38.523439 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-03996c0b-969a-4573-a9c6-e61e75674d0e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:38.562807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-2e0dca1a-3ce7-488d-969e-9b1c811efeee tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:38.581482 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-2e0dca1a-3ce7-488d-969e-9b1c811efeee tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.334176 Jun 16 16:14:38.599675 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 137/292] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:38 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:38.704526 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-03996c0b-969a-4573-a9c6-e61e75674d0e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:38.717064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-03996c0b-969a-4573-a9c6-e61e75674d0e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1217 microversion: 2.1 time: 0.216907 Jun 16 16:14:38.717981 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 156/293] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:38 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:39.613257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-80cfcfd3-dca3-433c-b511-7e203e5c6b85 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:39.615995 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-80cfcfd3-dca3-433c-b511-7e203e5c6b85 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:39.642653 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-80cfcfd3-dca3-433c-b511-7e203e5c6b85 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:39.643539 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-80cfcfd3-dca3-433c-b511-7e203e5c6b85 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:39.644633 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-80cfcfd3-dca3-433c-b511-7e203e5c6b85 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:39.656642 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-80cfcfd3-dca3-433c-b511-7e203e5c6b85 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:39.742889 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fdef08d9-d157-4f6f-995b-ddc5e6b9c834 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:39.746312 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fdef08d9-d157-4f6f-995b-ddc5e6b9c834 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:39.758822 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fdef08d9-d157-4f6f-995b-ddc5e6b9c834 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:39.760489 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fdef08d9-d157-4f6f-995b-ddc5e6b9c834 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:39.766080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fdef08d9-d157-4f6f-995b-ddc5e6b9c834 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:39.766956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fdef08d9-d157-4f6f-995b-ddc5e6b9c834 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:39.923481 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fdef08d9-d157-4f6f-995b-ddc5e6b9c834 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:39.944108 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fdef08d9-d157-4f6f-995b-ddc5e6b9c834 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1217 microversion: 2.1 time: 0.205575 Jun 16 16:14:39.946501 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 157/294] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:39 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1217 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:40.292498 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-80cfcfd3-dca3-433c-b511-7e203e5c6b85 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:40.302071 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-80cfcfd3-dca3-433c-b511-7e203e5c6b85 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.694712 Jun 16 16:14:40.307144 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 138/295] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:39 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:40.968252 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-725c3e2c-6679-489c-b98a-8ff3e261bdae tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:40.969339 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-725c3e2c-6679-489c-b98a-8ff3e261bdae tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:40.978170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-725c3e2c-6679-489c-b98a-8ff3e261bdae tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:40.979419 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-725c3e2c-6679-489c-b98a-8ff3e261bdae tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:40.980812 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-725c3e2c-6679-489c-b98a-8ff3e261bdae tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:40.981779 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-725c3e2c-6679-489c-b98a-8ff3e261bdae tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:41.145591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-725c3e2c-6679-489c-b98a-8ff3e261bdae tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:41.175997 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-725c3e2c-6679-489c-b98a-8ff3e261bdae tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1217 microversion: 2.1 time: 0.215207 Jun 16 16:14:41.178509 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 158/296] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:40 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:41.341640 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-050f30d3-2489-4d10-8a60-3bbdbcd48643 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:41.344793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-050f30d3-2489-4d10-8a60-3bbdbcd48643 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:41.389998 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-050f30d3-2489-4d10-8a60-3bbdbcd48643 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:41.392754 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-050f30d3-2489-4d10-8a60-3bbdbcd48643 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:41.396166 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-050f30d3-2489-4d10-8a60-3bbdbcd48643 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:41.397060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-050f30d3-2489-4d10-8a60-3bbdbcd48643 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:42.030412 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-050f30d3-2489-4d10-8a60-3bbdbcd48643 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:42.057705 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-050f30d3-2489-4d10-8a60-3bbdbcd48643 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.727494 Jun 16 16:14:42.059192 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 139/297] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:41 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:42.207342 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e3fb0ad9-4c02-42bd-be8f-e24059ad25fa tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:42.207988 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e3fb0ad9-4c02-42bd-be8f-e24059ad25fa tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:42.229032 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e3fb0ad9-4c02-42bd-be8f-e24059ad25fa tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:42.229600 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e3fb0ad9-4c02-42bd-be8f-e24059ad25fa tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:42.230756 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e3fb0ad9-4c02-42bd-be8f-e24059ad25fa tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:42.237147 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e3fb0ad9-4c02-42bd-be8f-e24059ad25fa tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:42.434286 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e3fb0ad9-4c02-42bd-be8f-e24059ad25fa tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:42.450173 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e3fb0ad9-4c02-42bd-be8f-e24059ad25fa tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1209 microversion: 2.1 time: 0.247849 Jun 16 16:14:42.451577 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 159/298] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:42 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1209 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:43.092813 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-16e3babf-eebf-43db-9c16-b9c4e2e90e73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:43.094663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-16e3babf-eebf-43db-9c16-b9c4e2e90e73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:43.113330 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-16e3babf-eebf-43db-9c16-b9c4e2e90e73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:43.119305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-16e3babf-eebf-43db-9c16-b9c4e2e90e73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:43.122539 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-16e3babf-eebf-43db-9c16-b9c4e2e90e73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:43.124508 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-16e3babf-eebf-43db-9c16-b9c4e2e90e73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:43.485479 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e0bc5c3b-6b21-4868-a6ac-f43781af86c3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:43.487063 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e0bc5c3b-6b21-4868-a6ac-f43781af86c3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:43.534516 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e0bc5c3b-6b21-4868-a6ac-f43781af86c3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:43.535111 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e0bc5c3b-6b21-4868-a6ac-f43781af86c3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:43.536407 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e0bc5c3b-6b21-4868-a6ac-f43781af86c3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:43.544518 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e0bc5c3b-6b21-4868-a6ac-f43781af86c3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:43.618871 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:43.680808 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-16e3babf-eebf-43db-9c16-b9c4e2e90e73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:43.693329 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-16e3babf-eebf-43db-9c16-b9c4e2e90e73 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.605891 Jun 16 16:14:43.695091 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 140/299] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:43 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:43.734985 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e0bc5c3b-6b21-4868-a6ac-f43781af86c3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:43.753622 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e0bc5c3b-6b21-4868-a6ac-f43781af86c3 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1209 microversion: 2.1 time: 0.275913 Jun 16 16:14:43.755689 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 160/300] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:43 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1209 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:44.205403 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d25c8ebc-fbbf-47f0-9ae3-184911c06dcc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Action: 'create', calling method: .version_select at 0x7f38c02acc10>, body: {"keypair": {"name": "tempest-keypair-774743181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDN308mZxAbZEYBDWZ4T7qzOV20Plu9Se8N/wbglp2fXEtGr3KKQ1chsUhx/cHWNXn1pCc4BdkDmyTRn8U0QMQTtl9P/1og4349x+qCCsdAdvOcbBgFwmK504tyefJx1jw=="}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:44.313702 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-d25c8ebc-fbbf-47f0-9ae3-184911c06dcc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for project b091584c67814e4d8f7e88f0596880e3. Resources: {'key_pairs'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:14:44.340775 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-d25c8ebc-fbbf-47f0-9ae3-184911c06dcc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for user 2c34f05634d34da29088bcf75069958d and project b091584c67814e4d8f7e88f0596880e3. Resources: {'key_pairs'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:14:44.479364 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d25c8ebc-fbbf-47f0-9ae3-184911c06dcc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.278898 Jun 16 16:14:44.491448 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 141/301] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 16:14:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:44.728057 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2c3752da-6469-4771-938c-b2fcd0ae448d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:44.729239 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2c3752da-6469-4771-938c-b2fcd0ae448d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:44.768404 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c3752da-6469-4771-938c-b2fcd0ae448d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:44.779915 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c3752da-6469-4771-938c-b2fcd0ae448d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:44.783808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c3752da-6469-4771-938c-b2fcd0ae448d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:44.785189 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-aa64ec14-28db-43cb-9d7f-a0b92f8bd7f1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:44.786127 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-aa64ec14-28db-43cb-9d7f-a0b92f8bd7f1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:44.788762 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c3752da-6469-4771-938c-b2fcd0ae448d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:44.810735 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aa64ec14-28db-43cb-9d7f-a0b92f8bd7f1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:44.813009 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aa64ec14-28db-43cb-9d7f-a0b92f8bd7f1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:44.816401 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aa64ec14-28db-43cb-9d7f-a0b92f8bd7f1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:44.817135 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aa64ec14-28db-43cb-9d7f-a0b92f8bd7f1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:45.075020 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-aa64ec14-28db-43cb-9d7f-a0b92f8bd7f1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:45.107353 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-aa64ec14-28db-43cb-9d7f-a0b92f8bd7f1 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1265 microversion: 2.1 time: 0.325535 Jun 16 16:14:45.111700 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 142/302] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:44 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1265 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:45.434166 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2c3752da-6469-4771-938c-b2fcd0ae448d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:45.456772 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2c3752da-6469-4771-938c-b2fcd0ae448d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.735234 Jun 16 16:14:45.460204 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 161/303] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:44 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:46.146032 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c57385fe-2eb6-4d5e-b540-2fb2f136d77a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:46.149842 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c57385fe-2eb6-4d5e-b540-2fb2f136d77a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:46.174203 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:46.188096 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c57385fe-2eb6-4d5e-b540-2fb2f136d77a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:46.189726 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c57385fe-2eb6-4d5e-b540-2fb2f136d77a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:46.191611 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c57385fe-2eb6-4d5e-b540-2fb2f136d77a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:46.194456 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c57385fe-2eb6-4d5e-b540-2fb2f136d77a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:46.472799 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c57385fe-2eb6-4d5e-b540-2fb2f136d77a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:46.492107 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c57385fe-2eb6-4d5e-b540-2fb2f136d77a tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1271 microversion: 2.1 time: 0.356185 Jun 16 16:14:46.494071 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 143/304] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:46 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1271 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:46.509372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0cc072b6-38b5-4a8c-ae1b-b68dafa32f50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:46.510461 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0cc072b6-38b5-4a8c-ae1b-b68dafa32f50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:46.548089 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=2 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:46.548089 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0cc072b6-38b5-4a8c-ae1b-b68dafa32f50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:46.548730 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0cc072b6-38b5-4a8c-ae1b-b68dafa32f50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:46.550198 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0cc072b6-38b5-4a8c-ae1b-b68dafa32f50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:46.551049 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0cc072b6-38b5-4a8c-ae1b-b68dafa32f50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:47.524020 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fbd645b1-fb4c-418c-ab9a-be33257d8693 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:47.531179 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-fbd645b1-fb4c-418c-ab9a-be33257d8693 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:47.553675 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fbd645b1-fb4c-418c-ab9a-be33257d8693 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:47.555406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fbd645b1-fb4c-418c-ab9a-be33257d8693 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:47.560659 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fbd645b1-fb4c-418c-ab9a-be33257d8693 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:47.562647 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fbd645b1-fb4c-418c-ab9a-be33257d8693 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:47.912845 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fbd645b1-fb4c-418c-ab9a-be33257d8693 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:47.925908 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fbd645b1-fb4c-418c-ab9a-be33257d8693 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1271 microversion: 2.1 time: 0.411389 Jun 16 16:14:47.932644 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 144/305] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:47 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1271 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:47.938219 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-115b3385-b150-44b0-84d9-2ddd58f9f163 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:47.947055 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-115b3385-b150-44b0-84d9-2ddd58f9f163 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:47.961807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-115b3385-b150-44b0-84d9-2ddd58f9f163 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:47.969007 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-115b3385-b150-44b0-84d9-2ddd58f9f163 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:47.971125 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-115b3385-b150-44b0-84d9-2ddd58f9f163 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:47.975333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-115b3385-b150-44b0-84d9-2ddd58f9f163 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:48.046052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-115b3385-b150-44b0-84d9-2ddd58f9f163 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/ips" status: 200 len: 146 microversion: 2.1 time: 0.111166 Jun 16 16:14:48.049056 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 145/306] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 16:14:47 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/ips => generated 146 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:48.711960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0cc072b6-38b5-4a8c-ae1b-b68dafa32f50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:48.749720 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0cc072b6-38b5-4a8c-ae1b-b68dafa32f50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 2.254117 Jun 16 16:14:48.752909 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 162/307] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:46 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:48.951176 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-207cb752-73af-4df4-b268-382efe654cfb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:48.951832 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-207cb752-73af-4df4-b268-382efe654cfb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:48.960868 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-207cb752-73af-4df4-b268-382efe654cfb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:48.965675 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-207cb752-73af-4df4-b268-382efe654cfb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:48.967454 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-207cb752-73af-4df4-b268-382efe654cfb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:48.967925 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-207cb752-73af-4df4-b268-382efe654cfb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:49.444911 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-207cb752-73af-4df4-b268-382efe654cfb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:49.467472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-207cb752-73af-4df4-b268-382efe654cfb tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1271 microversion: 2.1 time: 0.522131 Jun 16 16:14:49.479621 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 146/308] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:48 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1271 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:49.783251 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fc64c64f-7237-48dc-bc44-8c1fa98fb658 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:49.785645 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fc64c64f-7237-48dc-bc44-8c1fa98fb658 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:49.830557 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fc64c64f-7237-48dc-bc44-8c1fa98fb658 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:49.830557 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fc64c64f-7237-48dc-bc44-8c1fa98fb658 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:49.830557 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fc64c64f-7237-48dc-bc44-8c1fa98fb658 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:49.830557 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fc64c64f-7237-48dc-bc44-8c1fa98fb658 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:50.499288 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-bc6e794d-60ab-4407-8bfa-d3bbff350382 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:50.500643 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-bc6e794d-60ab-4407-8bfa-d3bbff350382 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:50.521168 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-bc6e794d-60ab-4407-8bfa-d3bbff350382 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:50.521817 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-bc6e794d-60ab-4407-8bfa-d3bbff350382 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:50.531243 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-bc6e794d-60ab-4407-8bfa-d3bbff350382 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:50.533218 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-bc6e794d-60ab-4407-8bfa-d3bbff350382 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:50.620577 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fc64c64f-7237-48dc-bc44-8c1fa98fb658 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:50.638965 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fc64c64f-7237-48dc-bc44-8c1fa98fb658 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1500 microversion: 2.1 time: 0.869368 Jun 16 16:14:50.641892 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 163/309] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:49 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1500 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:50.659277 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-679618083", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cdb4f4d1-8b7f-401f-9aab-5045d67bace2"}], "security_groups": [{"name": "tempest-securitygroup--630311232"}], "key_name": "tempest-keypair-774743181", "user_data": "}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:51.159295 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] validate_networks() for [('cdb4f4d1-8b7f-401f-9aab-5045d67bace2', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:14:51.335022 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-bc6e794d-60ab-4407-8bfa-d3bbff350382 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:51.359072 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-bc6e794d-60ab-4407-8bfa-d3bbff350382 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1313 microversion: 2.1 time: 0.863480 Jun 16 16:14:51.372804 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 147/310] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:50 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1313 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:51.372804 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e3bf5d53-d5a4-4eff-b1f6-b927c1d68f5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72e167e7-a7b2-4f9f-9725-20500fec9af1"}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:51.372804 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e3bf5d53-d5a4-4eff-b1f6-b927c1d68f5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:51.386748 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e3bf5d53-d5a4-4eff-b1f6-b927c1d68f5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:51.387447 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e3bf5d53-d5a4-4eff-b1f6-b927c1d68f5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:51.388365 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e3bf5d53-d5a4-4eff-b1f6-b927c1d68f5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:51.389213 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e3bf5d53-d5a4-4eff-b1f6-b927c1d68f5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:51.466291 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-e3bf5d53-d5a4-4eff-b1f6-b927c1d68f5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] HTTP exception thrown: Cannot 'attach_volume' instance 83df7777-6291-4644-a893-e1359c012b9f while it is in vm_state rescued Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e3bf5d53-d5a4-4eff-b1f6-b927c1d68f5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Request method failure captured: Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: POST /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f/os-volume_attachments HTTP/1.1 Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 74 Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ZJY_sf7_CaFp_lO20gYVdqLWXD7KbXNclHWQjc7pFk6nrkQF5CUv-8fhFY_sEa4Cuuwxdq5-z1gFim5Qvs5jD5K3YfctWCEQ53zozYHt_RA-tZlOmWWY7ue5LMWv7eCUbS2DS_i_lm-rWoECV8WYU-ge_gZY1PlPBE00XcuxlXLh4 Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 6eee49063a5847dba6ffb520d0149d88 Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-14364702 Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:14:51.468475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:14:51.470084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6eee49063a5847dba6ffb520d0149d88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6eee49063a5847dba6ffb520d0149d88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6eee49063a5847dba6ffb520d0149d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6eee49063a5847dba6ffb520d0149d88"}]}] Jun 16 16:14:51.470084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-ServerRescueNegativeTestJSON-14364702 Jun 16 16:14:51.470084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 6eee49063a5847dba6ffb520d0149d88 Jun 16 16:14:51.470084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-14364702 Jun 16 16:14:51.470084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-ServerRescueNegativeTestJSON-14364702-project Jun 16 16:14:51.470084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:14:51.470084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:14:51.470084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 515114f0a842463fb2d1265ee33db8eb Jun 16 16:14:51.470084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-ServerRescueNegativeTestJSON-14364702-project Jun 16 16:14:51.470084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Jun 16 16:14:51.470084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {"volumeAttachment": {"volumeId": "72e167e7-a7b2-4f9f-9725-20500fec9af1"}} Jun 16 16:14:51.470084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Cannot 'attach_volume' instance 83df7777-6291-4644-a893-e1359c012b9f while it is in vm_state rescued Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'server_id': '83df7777-6291-4644-a893-e1359c012b9f', 'body': {'volumeAttachment': {'volumeId': '72e167e7-a7b2-4f9f-9725-20500fec9af1'}}} Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83df7777-6291-4644-a893-e1359c012b9f in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:14:51.471037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 83df7777-6291-4644-a893-e1359c012b9f while it is in vm_state rescued Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:14:51.472389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:14:51.473711 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:14:51.473711 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:14:51.473711 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 83df7777-6291-4644-a893-e1359c012b9f while it is in vm_state rescued Jun 16 16:14:51.473711 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:14:51.475855 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e3bf5d53-d5a4-4eff-b1f6-b927c1d68f5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Returning 409 to user: Cannot 'attach_volume' instance 83df7777-6291-4644-a893-e1359c012b9f while it is in vm_state rescued {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:14:51.477402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e3bf5d53-d5a4-4eff-b1f6-b927c1d68f5a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "POST /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.113580 Jun 16 16:14:51.482324 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 148/311] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 16:14:51 2022] POST /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f/os-volume_attachments => generated 152 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 16:14:51.491978 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d5c0bb09-64c8-4321-a2c9-cae9af82dab3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "334f3d46-bd7b-4218-ba68-e815b0ac2fd1"}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:51.493640 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d5c0bb09-64c8-4321-a2c9-cae9af82dab3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:51.503074 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5c0bb09-64c8-4321-a2c9-cae9af82dab3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:51.504521 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5c0bb09-64c8-4321-a2c9-cae9af82dab3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:51.505911 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5c0bb09-64c8-4321-a2c9-cae9af82dab3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:51.506746 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5c0bb09-64c8-4321-a2c9-cae9af82dab3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:51.949101 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:14:51.949757 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:14:51.951207 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:14:51.952999 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:14:51.952999 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:14:51.966406 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:51.967210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:51.968127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:51.968783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:52.012004 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for project b091584c67814e4d8f7e88f0596880e3. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:14:52.016796 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for user 2c34f05634d34da29088bcf75069958d and project b091584c67814e4d8f7e88f0596880e3. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:14:52.033777 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:14:52.036334 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:14:52.116466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ef8ffc38-f19c-40e7-ae6d-f742d3db891a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.471344 Jun 16 16:14:52.118598 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 164/312] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:14:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 1476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:14:52.129089 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c120b9e7-4817-470d-a0dc-391af769ae61 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:52.130097 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c120b9e7-4817-470d-a0dc-391af769ae61 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:52.182074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c120b9e7-4817-470d-a0dc-391af769ae61 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:52.187931 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c120b9e7-4817-470d-a0dc-391af769ae61 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:52.192131 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c120b9e7-4817-470d-a0dc-391af769ae61 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:52.193683 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c120b9e7-4817-470d-a0dc-391af769ae61 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:52.390122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c120b9e7-4817-470d-a0dc-391af769ae61 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "POST /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f/action" status: 202 len: 0 microversion: 2.1 time: 0.268141 Jun 16 16:14:52.392160 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 165/313] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 16:14:52 2022] POST /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:14:52.420876 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-372d55a9-8550-453a-a757-09bb6609d8c1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:52.421713 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-372d55a9-8550-453a-a757-09bb6609d8c1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:52.605427 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-372d55a9-8550-453a-a757-09bb6609d8c1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:52.641097 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-372d55a9-8550-453a-a757-09bb6609d8c1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1240 microversion: 2.1 time: 0.246544 Jun 16 16:14:52.646394 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 166/314] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:52 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1240 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:52.668040 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d0799c00-604f-464f-b3f8-e5308f598961 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:52.674580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d0799c00-604f-464f-b3f8-e5308f598961 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:52.702233 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0799c00-604f-464f-b3f8-e5308f598961 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:52.703653 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0799c00-604f-464f-b3f8-e5308f598961 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:52.705352 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0799c00-604f-464f-b3f8-e5308f598961 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:52.706852 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d0799c00-604f-464f-b3f8-e5308f598961 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:53.112197 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d0799c00-604f-464f-b3f8-e5308f598961 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:53.132226 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d0799c00-604f-464f-b3f8-e5308f598961 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1313 microversion: 2.1 time: 0.483577 Jun 16 16:14:53.134371 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 167/315] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:52 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:53.145851 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b0de92cd-9026-439f-aed1-e540639801da tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:53.148114 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b0de92cd-9026-439f-aed1-e540639801da tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:53.162382 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b0de92cd-9026-439f-aed1-e540639801da tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:53.163245 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b0de92cd-9026-439f-aed1-e540639801da tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:53.165468 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b0de92cd-9026-439f-aed1-e540639801da tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:53.166311 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b0de92cd-9026-439f-aed1-e540639801da tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:53.422411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b0de92cd-9026-439f-aed1-e540639801da tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:53.438903 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b0de92cd-9026-439f-aed1-e540639801da tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1508 microversion: 2.1 time: 0.301806 Jun 16 16:14:53.440150 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 168/316] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:53 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1508 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:53.665777 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6d29f9c8-c983-4fb2-80bc-b1195011ff5f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:53.666636 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6d29f9c8-c983-4fb2-80bc-b1195011ff5f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:53.674963 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d29f9c8-c983-4fb2-80bc-b1195011ff5f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:53.675884 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d29f9c8-c983-4fb2-80bc-b1195011ff5f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:53.677259 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d29f9c8-c983-4fb2-80bc-b1195011ff5f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:53.678332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d29f9c8-c983-4fb2-80bc-b1195011ff5f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:53.880503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6d29f9c8-c983-4fb2-80bc-b1195011ff5f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:53.896010 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6d29f9c8-c983-4fb2-80bc-b1195011ff5f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1244 microversion: 2.1 time: 0.235069 Jun 16 16:14:53.896581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 169/317] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:53 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1244 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:54.160659 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c73eb8d3-fe04-44a6-aa3b-ba08a2dccb6f tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:54.161881 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c73eb8d3-fe04-44a6-aa3b-ba08a2dccb6f tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:54.169170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c73eb8d3-fe04-44a6-aa3b-ba08a2dccb6f tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:54.170255 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c73eb8d3-fe04-44a6-aa3b-ba08a2dccb6f tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:54.171168 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c73eb8d3-fe04-44a6-aa3b-ba08a2dccb6f tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:54.171968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c73eb8d3-fe04-44a6-aa3b-ba08a2dccb6f tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:54.380233 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c73eb8d3-fe04-44a6-aa3b-ba08a2dccb6f tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:54.380933 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=10 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:54.402290 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c73eb8d3-fe04-44a6-aa3b-ba08a2dccb6f tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1313 microversion: 2.1 time: 0.245666 Jun 16 16:14:54.407719 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 170/318] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:54 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:54.467001 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5031f65e-04c9-4ed9-a25c-8dcd56ce458a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:54.468917 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5031f65e-04c9-4ed9-a25c-8dcd56ce458a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:54.484314 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5031f65e-04c9-4ed9-a25c-8dcd56ce458a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:54.486687 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5031f65e-04c9-4ed9-a25c-8dcd56ce458a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:54.488871 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5031f65e-04c9-4ed9-a25c-8dcd56ce458a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:54.493098 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5031f65e-04c9-4ed9-a25c-8dcd56ce458a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:54.674493 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:54.759878 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d5c0bb09-64c8-4321-a2c9-cae9af82dab3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "POST /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.271997 Jun 16 16:14:54.763464 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 149/319] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 16:14:51 2022] POST /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/os-volume_attachments => generated 194 bytes in 3280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:54.935890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-22574f3c-5c80-4b0f-81c8-a8d52454d310 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:54.939030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-22574f3c-5c80-4b0f-81c8-a8d52454d310 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:54.992916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-22574f3c-5c80-4b0f-81c8-a8d52454d310 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:54.997792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-22574f3c-5c80-4b0f-81c8-a8d52454d310 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:55.001181 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-22574f3c-5c80-4b0f-81c8-a8d52454d310 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:55.003976 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-22574f3c-5c80-4b0f-81c8-a8d52454d310 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:55.183566 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5031f65e-04c9-4ed9-a25c-8dcd56ce458a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:55.202231 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5031f65e-04c9-4ed9-a25c-8dcd56ce458a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1508 microversion: 2.1 time: 0.744514 Jun 16 16:14:55.203801 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 171/320] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:54 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1508 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:55.218841 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-22574f3c-5c80-4b0f-81c8-a8d52454d310 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:55.234705 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-22574f3c-5c80-4b0f-81c8-a8d52454d310 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1292 microversion: 2.1 time: 0.320886 Jun 16 16:14:55.236029 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 150/321] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:54 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1292 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:55.443111 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a010ccd1-0055-4a20-84f3-8a48eb745be9 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:55.459546 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a010ccd1-0055-4a20-84f3-8a48eb745be9 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:55.480890 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a010ccd1-0055-4a20-84f3-8a48eb745be9 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:55.483205 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a010ccd1-0055-4a20-84f3-8a48eb745be9 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:55.485216 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a010ccd1-0055-4a20-84f3-8a48eb745be9 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:55.487658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a010ccd1-0055-4a20-84f3-8a48eb745be9 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:55.812658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a010ccd1-0055-4a20-84f3-8a48eb745be9 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:55.830582 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a010ccd1-0055-4a20-84f3-8a48eb745be9 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1313 microversion: 2.1 time: 0.405775 Jun 16 16:14:55.834098 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 172/322] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:55 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:56.231652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e351e6d8-4b10-4430-a3c9-f374357e8590 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:56.232854 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e351e6d8-4b10-4430-a3c9-f374357e8590 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:56.270038 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bff16eca-79fa-46a8-b0b0-bce42fd90909 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:56.271317 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bff16eca-79fa-46a8-b0b0-bce42fd90909 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:56.299080 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e351e6d8-4b10-4430-a3c9-f374357e8590 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:56.300657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e351e6d8-4b10-4430-a3c9-f374357e8590 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:56.302750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e351e6d8-4b10-4430-a3c9-f374357e8590 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:56.308928 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e351e6d8-4b10-4430-a3c9-f374357e8590 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:56.366145 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bff16eca-79fa-46a8-b0b0-bce42fd90909 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:56.366676 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bff16eca-79fa-46a8-b0b0-bce42fd90909 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:56.372501 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bff16eca-79fa-46a8-b0b0-bce42fd90909 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:56.375017 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bff16eca-79fa-46a8-b0b0-bce42fd90909 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:56.779166 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bff16eca-79fa-46a8-b0b0-bce42fd90909 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:56.801461 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bff16eca-79fa-46a8-b0b0-bce42fd90909 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1298 microversion: 2.1 time: 0.544050 Jun 16 16:14:56.812720 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 173/323] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:56 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1298 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:56.868944 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0edbf933-1955-4aef-8514-dfd6bad38c10 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:56.870098 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0edbf933-1955-4aef-8514-dfd6bad38c10 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:56.888062 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0edbf933-1955-4aef-8514-dfd6bad38c10 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:56.888886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0edbf933-1955-4aef-8514-dfd6bad38c10 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:56.890083 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0edbf933-1955-4aef-8514-dfd6bad38c10 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:56.890625 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0edbf933-1955-4aef-8514-dfd6bad38c10 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:57.361164 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0edbf933-1955-4aef-8514-dfd6bad38c10 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:57.384710 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e351e6d8-4b10-4430-a3c9-f374357e8590 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:57.404722 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0edbf933-1955-4aef-8514-dfd6bad38c10 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1313 microversion: 2.1 time: 0.540838 Jun 16 16:14:57.407138 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 174/324] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:56 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1313 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:57.409973 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e351e6d8-4b10-4430-a3c9-f374357e8590 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1508 microversion: 2.1 time: 1.190578 Jun 16 16:14:57.432233 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 151/325] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:56 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1508 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:57.438362 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-feb5f93c-0a13-4763-a15c-1e71561a4d69 req-f64b8bba-f90e-4a47-a18f-8c05d52dedfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3", "tag": "7bbaaa0e-42ee-4dab-b7e9-1093b4d31756"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:57.451539 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-feb5f93c-0a13-4763-a15c-1e71561a4d69 req-f64b8bba-f90e-4a47-a18f-8c05d52dedfc service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:57.451993 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-feb5f93c-0a13-4763-a15c-1e71561a4d69 req-f64b8bba-f90e-4a47-a18f-8c05d52dedfc service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:57.478122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-feb5f93c-0a13-4763-a15c-1e71561a4d69 req-f64b8bba-f90e-4a47-a18f-8c05d52dedfc service nova] Creating event network-changed:7bbaaa0e-42ee-4dab-b7e9-1093b4d31756 for instance b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 on hv-cinder-83716 Jun 16 16:14:57.485083 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-feb5f93c-0a13-4763-a15c-1e71561a4d69 req-f64b8bba-f90e-4a47-a18f-8c05d52dedfc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073943 Jun 16 16:14:57.486125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 175/326] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:57.835352 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-2c3f9c58-b117-44f1-ad5a-abb558650cc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:57.837072 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2c3f9c58-b117-44f1-ad5a-abb558650cc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:57.860120 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2c3f9c58-b117-44f1-ad5a-abb558650cc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:57.860892 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2c3f9c58-b117-44f1-ad5a-abb558650cc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:57.862269 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2c3f9c58-b117-44f1-ad5a-abb558650cc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:57.864089 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2c3f9c58-b117-44f1-ad5a-abb558650cc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:58.014263 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-2c3f9c58-b117-44f1-ad5a-abb558650cc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:58.027633 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-2c3f9c58-b117-44f1-ad5a-abb558650cc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1298 microversion: 2.1 time: 0.207221 Jun 16 16:14:58.029413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 152/327] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:57 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1298 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:58.439747 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b59c4d1f-5abd-45cc-96bd-69925a47ca6d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:58.441222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b59c4d1f-5abd-45cc-96bd-69925a47ca6d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:58.449809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fc1fd43f-9ff5-45c4-a2c5-11a47a11ef06 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:58.454848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b59c4d1f-5abd-45cc-96bd-69925a47ca6d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:58.455696 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b59c4d1f-5abd-45cc-96bd-69925a47ca6d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:58.457301 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b59c4d1f-5abd-45cc-96bd-69925a47ca6d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:58.458325 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b59c4d1f-5abd-45cc-96bd-69925a47ca6d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:58.459154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-fc1fd43f-9ff5-45c4-a2c5-11a47a11ef06 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:58.479467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fc1fd43f-9ff5-45c4-a2c5-11a47a11ef06 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:58.480640 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fc1fd43f-9ff5-45c4-a2c5-11a47a11ef06 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:58.482380 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fc1fd43f-9ff5-45c4-a2c5-11a47a11ef06 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:58.483724 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fc1fd43f-9ff5-45c4-a2c5-11a47a11ef06 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:58.842308 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b59c4d1f-5abd-45cc-96bd-69925a47ca6d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:58.859660 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b59c4d1f-5abd-45cc-96bd-69925a47ca6d tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1313 microversion: 2.1 time: 0.429533 Jun 16 16:14:58.870861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 176/328] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:58 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:59.064211 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5c2d6a41-80db-4a4e-9abd-25d7c3b95527 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:59.068326 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5c2d6a41-80db-4a4e-9abd-25d7c3b95527 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:59.100808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c2d6a41-80db-4a4e-9abd-25d7c3b95527 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:59.106077 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c2d6a41-80db-4a4e-9abd-25d7c3b95527 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:59.107754 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c2d6a41-80db-4a4e-9abd-25d7c3b95527 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:59.111331 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5c2d6a41-80db-4a4e-9abd-25d7c3b95527 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:59.275784 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fc1fd43f-9ff5-45c4-a2c5-11a47a11ef06 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:59.362002 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fc1fd43f-9ff5-45c4-a2c5-11a47a11ef06 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1508 microversion: 2.1 time: 0.905464 Jun 16 16:14:59.366082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 153/329] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:58 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1508 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:59.433715 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5c2d6a41-80db-4a4e-9abd-25d7c3b95527 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:59.469287 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5c2d6a41-80db-4a4e-9abd-25d7c3b95527 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1298 microversion: 2.1 time: 0.414369 Jun 16 16:14:59.486013 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 177/330] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:59 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1298 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:59.885352 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4a7d466b-7cde-468f-a1d7-5349ada4c895 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:59.886394 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4a7d466b-7cde-468f-a1d7-5349ada4c895 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:59.900733 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4a7d466b-7cde-468f-a1d7-5349ada4c895 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:59.901527 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4a7d466b-7cde-468f-a1d7-5349ada4c895 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:59.903091 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4a7d466b-7cde-468f-a1d7-5349ada4c895 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:59.907910 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4a7d466b-7cde-468f-a1d7-5349ada4c895 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:00.396807 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-751c74f4-613c-4975-b070-def9ba3fc87c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:00.397555 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-751c74f4-613c-4975-b070-def9ba3fc87c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:00.412132 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-751c74f4-613c-4975-b070-def9ba3fc87c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:00.412952 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-751c74f4-613c-4975-b070-def9ba3fc87c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:00.414773 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-751c74f4-613c-4975-b070-def9ba3fc87c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:00.415321 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-751c74f4-613c-4975-b070-def9ba3fc87c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:00.424128 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:00.475280 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4a7d466b-7cde-468f-a1d7-5349ada4c895 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:00.512370 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4a7d466b-7cde-468f-a1d7-5349ada4c895 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1313 microversion: 2.1 time: 0.631922 Jun 16 16:15:00.515783 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 154/331] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:59 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1313 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:00.528970 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-da80d226-2da9-4f2a-8805-c797829b2837 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:00.528970 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-da80d226-2da9-4f2a-8805-c797829b2837 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:00.556907 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-da80d226-2da9-4f2a-8805-c797829b2837 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:00.557859 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-da80d226-2da9-4f2a-8805-c797829b2837 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:00.559436 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-da80d226-2da9-4f2a-8805-c797829b2837 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:00.560244 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-da80d226-2da9-4f2a-8805-c797829b2837 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:00.817285 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-da80d226-2da9-4f2a-8805-c797829b2837 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:00.851304 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-da80d226-2da9-4f2a-8805-c797829b2837 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1298 microversion: 2.1 time: 0.333773 Jun 16 16:15:00.874510 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 155/332] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:00 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1298 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:00.976030 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-751c74f4-613c-4975-b070-def9ba3fc87c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:01.005805 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-751c74f4-613c-4975-b070-def9ba3fc87c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1514 microversion: 2.1 time: 0.611597 Jun 16 16:15:01.018256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 178/333] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:00 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1514 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:01.543030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f9054010-a1f8-4031-9801-e4d1355b400e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:01.544694 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f9054010-a1f8-4031-9801-e4d1355b400e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:01.576511 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f9054010-a1f8-4031-9801-e4d1355b400e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:01.577015 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f9054010-a1f8-4031-9801-e4d1355b400e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:01.582256 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f9054010-a1f8-4031-9801-e4d1355b400e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:01.587785 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f9054010-a1f8-4031-9801-e4d1355b400e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:01.889179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e06931ea-e05b-46bf-a54f-c8e2911be5f3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:01.894945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e06931ea-e05b-46bf-a54f-c8e2911be5f3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:01.905634 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:01.916500 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e06931ea-e05b-46bf-a54f-c8e2911be5f3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:01.918654 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e06931ea-e05b-46bf-a54f-c8e2911be5f3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:01.923919 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e06931ea-e05b-46bf-a54f-c8e2911be5f3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:01.924848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e06931ea-e05b-46bf-a54f-c8e2911be5f3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:02.090231 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=2 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:02.621700 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=8 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:02.768158 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e06931ea-e05b-46bf-a54f-c8e2911be5f3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:02.800241 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e06931ea-e05b-46bf-a54f-c8e2911be5f3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1365 microversion: 2.1 time: 0.914911 Jun 16 16:15:02.811468 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 179/334] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:01 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1365 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:03.449267 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f9054010-a1f8-4031-9801-e4d1355b400e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:03.460170 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f9054010-a1f8-4031-9801-e4d1355b400e tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1313 microversion: 2.1 time: 1.925557 Jun 16 16:15:03.474434 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 156/335] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:01 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1313 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:03.734766 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4474dbf5-18fd-403c-9b5c-6b35ce6711e9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Action: 'create', calling method: .version_select at 0x7f38bb765dc0>, body: {"keypair": {"name": "tempest-keypair-1920817915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvvKMo6GCZL+ZNffBFTQXdTDhXyI64TfnYMdYOsQecnn+9jAMOJxecudHku/oVepJhUtrC3OZGtDwL9Y25rH4DbAXHnAzzlzVqRgNAI0jb1DmA6fJkGEio7c0v5bpiYCA=="}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:03.785288 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-4474dbf5-18fd-403c-9b5c-6b35ce6711e9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Getting quotas for project 6eee49063a5847dba6ffb520d0149d88. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:15:03.813141 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-4474dbf5-18fd-403c-9b5c-6b35ce6711e9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Getting quotas for user 515114f0a842463fb2d1265ee33db8eb and project 6eee49063a5847dba6ffb520d0149d88. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:15:03.842967 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-2d319b7f-3344-4aed-aeaf-8dabff6fafcc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:03.843748 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2d319b7f-3344-4aed-aeaf-8dabff6fafcc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:03.891926 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2d319b7f-3344-4aed-aeaf-8dabff6fafcc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:03.896727 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2d319b7f-3344-4aed-aeaf-8dabff6fafcc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:03.913550 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2d319b7f-3344-4aed-aeaf-8dabff6fafcc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:03.914407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2d319b7f-3344-4aed-aeaf-8dabff6fafcc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:03.937542 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4474dbf5-18fd-403c-9b5c-6b35ce6711e9 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.209967 Jun 16 16:15:03.940889 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 180/336] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 16:15:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:15:03.981914 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-60bf15b1-cc62-44d9-a1e9-fff9e587ba2b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:04.046161 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-60bf15b1-cc62-44d9-a1e9-fff9e587ba2b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:04.047419 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-60bf15b1-cc62-44d9-a1e9-fff9e587ba2b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:04.329614 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-60bf15b1-cc62-44d9-a1e9-fff9e587ba2b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Going to try to stop instance {{(pid=117755) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 16:15:04.483702 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-60bf15b1-cc62-44d9-a1e9-fff9e587ba2b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "POST /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/action" status: 202 len: 0 microversion: 2.1 time: 0.541068 Jun 16 16:15:04.485272 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 181/337] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 16:15:03 2022] POST /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:15:04.533463 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fc19c687-fbb8-47bf-a1bd-e0761569c458 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:04.536443 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fc19c687-fbb8-47bf-a1bd-e0761569c458 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:04.556978 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fc19c687-fbb8-47bf-a1bd-e0761569c458 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:04.562335 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fc19c687-fbb8-47bf-a1bd-e0761569c458 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:04.569632 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fc19c687-fbb8-47bf-a1bd-e0761569c458 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:04.572029 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fc19c687-fbb8-47bf-a1bd-e0761569c458 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:04.629248 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-2d319b7f-3344-4aed-aeaf-8dabff6fafcc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:04.663146 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-2d319b7f-3344-4aed-aeaf-8dabff6fafcc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1365 microversion: 2.1 time: 0.835889 Jun 16 16:15:04.680913 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 157/338] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:03 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1365 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:04.698470 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-bda2cbe6-08d7-4b5e-af42-6b1be4d6b974 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:04.699936 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-bda2cbe6-08d7-4b5e-af42-6b1be4d6b974 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:04.732561 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-bda2cbe6-08d7-4b5e-af42-6b1be4d6b974 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:04.742559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-bda2cbe6-08d7-4b5e-af42-6b1be4d6b974 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:04.744638 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-bda2cbe6-08d7-4b5e-af42-6b1be4d6b974 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:04.751922 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-bda2cbe6-08d7-4b5e-af42-6b1be4d6b974 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:05.383398 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fc19c687-fbb8-47bf-a1bd-e0761569c458 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:05.411525 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fc19c687-fbb8-47bf-a1bd-e0761569c458 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1313 microversion: 2.1 time: 0.886392 Jun 16 16:15:05.415095 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 182/339] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:04 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1313 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:05.690345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-baf76fc8-3698-4123-8e4f-484bc7ee543f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:05.692328 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-baf76fc8-3698-4123-8e4f-484bc7ee543f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:05.710535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-baf76fc8-3698-4123-8e4f-484bc7ee543f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:05.712498 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-baf76fc8-3698-4123-8e4f-484bc7ee543f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:05.716935 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-baf76fc8-3698-4123-8e4f-484bc7ee543f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:05.724481 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-baf76fc8-3698-4123-8e4f-484bc7ee543f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:05.941183 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-bda2cbe6-08d7-4b5e-af42-6b1be4d6b974 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:05.975852 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-bda2cbe6-08d7-4b5e-af42-6b1be4d6b974 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 1.291092 Jun 16 16:15:05.979624 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 158/340] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:04 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:06.021169 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-df9513b2-83ce-46da-998c-cefa18e7a6b6 req-d62f60c1-d4d7-4be2-b3b9-4e6b1de86d7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f1126e-5b19-4b56-aa87-c4be0b53eb85", "tag": "1e1c5a67-e2e5-4c4d-9bb0-aaeddbf28281"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:06.046987 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:06.091839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-df9513b2-83ce-46da-998c-cefa18e7a6b6 req-d62f60c1-d4d7-4be2-b3b9-4e6b1de86d7c service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:06.103556 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-df9513b2-83ce-46da-998c-cefa18e7a6b6 req-d62f60c1-d4d7-4be2-b3b9-4e6b1de86d7c service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:06.199265 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-df9513b2-83ce-46da-998c-cefa18e7a6b6 req-d62f60c1-d4d7-4be2-b3b9-4e6b1de86d7c service nova] Creating event network-changed:1e1c5a67-e2e5-4c4d-9bb0-aaeddbf28281 for instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 on hv-cinder-83716 Jun 16 16:15:06.216941 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-df9513b2-83ce-46da-998c-cefa18e7a6b6 req-d62f60c1-d4d7-4be2-b3b9-4e6b1de86d7c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230814 Jun 16 16:15:06.218760 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 159/341] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:06.437621 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1c3c1e1b-7594-45dc-bf6d-905c198c2b49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:06.445745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1c3c1e1b-7594-45dc-bf6d-905c198c2b49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:06.488643 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1c3c1e1b-7594-45dc-bf6d-905c198c2b49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:06.497808 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1c3c1e1b-7594-45dc-bf6d-905c198c2b49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:06.500221 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1c3c1e1b-7594-45dc-bf6d-905c198c2b49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:06.510689 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1c3c1e1b-7594-45dc-bf6d-905c198c2b49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:06.555150 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-baf76fc8-3698-4123-8e4f-484bc7ee543f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:06.591158 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-baf76fc8-3698-4123-8e4f-484bc7ee543f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1365 microversion: 2.1 time: 0.907570 Jun 16 16:15:06.591866 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 183/342] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:05 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1365 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:07.009395 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a953d01d-1c75-4799-9aeb-aef3387478ee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:07.013703 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a953d01d-1c75-4799-9aeb-aef3387478ee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:07.062640 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a953d01d-1c75-4799-9aeb-aef3387478ee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:07.067784 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a953d01d-1c75-4799-9aeb-aef3387478ee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:07.069576 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a953d01d-1c75-4799-9aeb-aef3387478ee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:07.073580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a953d01d-1c75-4799-9aeb-aef3387478ee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:07.156771 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1c3c1e1b-7594-45dc-bf6d-905c198c2b49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:07.203479 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1c3c1e1b-7594-45dc-bf6d-905c198c2b49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1313 microversion: 2.1 time: 0.774734 Jun 16 16:15:07.204524 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 160/343] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:06 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1313 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:07.557668 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a953d01d-1c75-4799-9aeb-aef3387478ee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:07.569726 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a953d01d-1c75-4799-9aeb-aef3387478ee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.572503 Jun 16 16:15:07.575302 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 184/344] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:06 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:07.615682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7520ff87-d3b1-43e6-b2ae-9db4d03b6522 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:07.617540 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7520ff87-d3b1-43e6-b2ae-9db4d03b6522 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:07.647029 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7520ff87-d3b1-43e6-b2ae-9db4d03b6522 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:07.650596 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7520ff87-d3b1-43e6-b2ae-9db4d03b6522 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:07.659332 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7520ff87-d3b1-43e6-b2ae-9db4d03b6522 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:07.660055 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7520ff87-d3b1-43e6-b2ae-9db4d03b6522 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:08.046109 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7520ff87-d3b1-43e6-b2ae-9db4d03b6522 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:08.063755 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7520ff87-d3b1-43e6-b2ae-9db4d03b6522 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1365 microversion: 2.1 time: 0.454076 Jun 16 16:15:08.082531 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 161/345] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:07 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1365 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:08.230646 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fcc88767-2502-4ec8-8665-afac20e34eac tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:08.255121 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fcc88767-2502-4ec8-8665-afac20e34eac tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:08.281767 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fcc88767-2502-4ec8-8665-afac20e34eac tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:08.284850 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fcc88767-2502-4ec8-8665-afac20e34eac tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:08.286611 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fcc88767-2502-4ec8-8665-afac20e34eac tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:08.287690 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fcc88767-2502-4ec8-8665-afac20e34eac tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:08.617701 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-db920127-3198-4dce-afd0-a43494ed6509 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:08.619031 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-db920127-3198-4dce-afd0-a43494ed6509 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:08.628082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-db920127-3198-4dce-afd0-a43494ed6509 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:08.628731 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-db920127-3198-4dce-afd0-a43494ed6509 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:08.629728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-db920127-3198-4dce-afd0-a43494ed6509 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:08.630370 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-db920127-3198-4dce-afd0-a43494ed6509 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:08.945770 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-db920127-3198-4dce-afd0-a43494ed6509 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:08.969338 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-db920127-3198-4dce-afd0-a43494ed6509 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.367844 Jun 16 16:15:08.969338 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 162/346] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:08 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:09.097321 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-14cc50d1-5c8c-4372-b718-02db672450c1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:09.098871 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-14cc50d1-5c8c-4372-b718-02db672450c1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:09.120573 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-14cc50d1-5c8c-4372-b718-02db672450c1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:09.125678 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-14cc50d1-5c8c-4372-b718-02db672450c1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:09.133818 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fcc88767-2502-4ec8-8665-afac20e34eac tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:09.138823 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-14cc50d1-5c8c-4372-b718-02db672450c1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:09.139643 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-14cc50d1-5c8c-4372-b718-02db672450c1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:09.166316 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fcc88767-2502-4ec8-8665-afac20e34eac tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1313 microversion: 2.1 time: 0.941962 Jun 16 16:15:09.172168 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 185/347] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:08 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1313 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:09.586155 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1909954928", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84d0c54c-ef5a-4a19-a82f-2cbc7460411e"}], "security_groups": [{"name": "tempest-securitygroup--1025797521"}], "key_name": "tempest-keypair-1920817915", "user_data": "}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:09.790387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-14cc50d1-5c8c-4372-b718-02db672450c1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:09.807865 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-14cc50d1-5c8c-4372-b718-02db672450c1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1365 microversion: 2.1 time: 0.719517 Jun 16 16:15:09.808963 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 163/348] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:09 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1365 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:09.995803 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ef4fc060-2a1a-4e9b-b8a4-aeb510243e89 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:09.997189 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ef4fc060-2a1a-4e9b-b8a4-aeb510243e89 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:10.008341 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ef4fc060-2a1a-4e9b-b8a4-aeb510243e89 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:10.009241 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ef4fc060-2a1a-4e9b-b8a4-aeb510243e89 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:10.013119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ef4fc060-2a1a-4e9b-b8a4-aeb510243e89 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:10.014258 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ef4fc060-2a1a-4e9b-b8a4-aeb510243e89 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:10.388683 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ef4fc060-2a1a-4e9b-b8a4-aeb510243e89 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:10.403332 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ef4fc060-2a1a-4e9b-b8a4-aeb510243e89 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.420762 Jun 16 16:15:10.419211 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 164/349] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:09 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:10.428437 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4b05bc4e-3000-444c-877b-1c07ea91be49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:10.429793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4b05bc4e-3000-444c-877b-1c07ea91be49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:10.441974 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4b05bc4e-3000-444c-877b-1c07ea91be49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:10.442621 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4b05bc4e-3000-444c-877b-1c07ea91be49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:10.446455 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4b05bc4e-3000-444c-877b-1c07ea91be49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:10.447462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4b05bc4e-3000-444c-877b-1c07ea91be49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:10.686794 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4b05bc4e-3000-444c-877b-1c07ea91be49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:10.706646 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4b05bc4e-3000-444c-877b-1c07ea91be49 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1313 microversion: 2.1 time: 0.285535 Jun 16 16:15:10.708209 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 165/350] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:10 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:10.833857 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-35d17e21-bd3c-4e61-aedf-9cab02bf2f5a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:10.834995 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-35d17e21-bd3c-4e61-aedf-9cab02bf2f5a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:10.850274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-35d17e21-bd3c-4e61-aedf-9cab02bf2f5a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:10.850663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-35d17e21-bd3c-4e61-aedf-9cab02bf2f5a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:10.853808 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-35d17e21-bd3c-4e61-aedf-9cab02bf2f5a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:10.856202 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-35d17e21-bd3c-4e61-aedf-9cab02bf2f5a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:10.918020 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:11.255939 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-35d17e21-bd3c-4e61-aedf-9cab02bf2f5a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:11.275340 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-35d17e21-bd3c-4e61-aedf-9cab02bf2f5a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1365 microversion: 2.1 time: 0.449260 Jun 16 16:15:11.277703 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 166/351] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:10 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1365 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:11.292127 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-c6561fe6-5ec8-42ce-954e-ed8c8e31d2c3 req-5a8a49ab-41a1-4854-ab82-3e6564e4ff42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3", "name": "network-vif-plugged", "status": "completed", "tag": "7bbaaa0e-42ee-4dab-b7e9-1093b4d31756"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:11.327882 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-c6561fe6-5ec8-42ce-954e-ed8c8e31d2c3 req-5a8a49ab-41a1-4854-ab82-3e6564e4ff42 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:11.328895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-c6561fe6-5ec8-42ce-954e-ed8c8e31d2c3 req-5a8a49ab-41a1-4854-ab82-3e6564e4ff42 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:11.355857 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-c6561fe6-5ec8-42ce-954e-ed8c8e31d2c3 req-5a8a49ab-41a1-4854-ab82-3e6564e4ff42 service nova] Creating event network-vif-plugged:7bbaaa0e-42ee-4dab-b7e9-1093b4d31756 for instance b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 on hv-cinder-83716 Jun 16 16:15:11.362412 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-c6561fe6-5ec8-42ce-954e-ed8c8e31d2c3 req-5a8a49ab-41a1-4854-ab82-3e6564e4ff42 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082561 Jun 16 16:15:11.363978 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 167/352] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:11.442669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ab16b1cc-cb43-4aa6-a9ab-ad129bef08d7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:11.451832 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ab16b1cc-cb43-4aa6-a9ab-ad129bef08d7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:11.483101 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ab16b1cc-cb43-4aa6-a9ab-ad129bef08d7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:11.483902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ab16b1cc-cb43-4aa6-a9ab-ad129bef08d7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:11.485046 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ab16b1cc-cb43-4aa6-a9ab-ad129bef08d7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:11.485875 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ab16b1cc-cb43-4aa6-a9ab-ad129bef08d7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:11.862875 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ab16b1cc-cb43-4aa6-a9ab-ad129bef08d7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:11.884410 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ab16b1cc-cb43-4aa6-a9ab-ad129bef08d7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.456608 Jun 16 16:15:11.885438 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 168/353] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:11 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:11.902248 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b153a799-bdf8-4d91-acb8-10fddcb1b792 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:11.902918 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b153a799-bdf8-4d91-acb8-10fddcb1b792 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:11.915823 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b153a799-bdf8-4d91-acb8-10fddcb1b792 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:11.917021 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b153a799-bdf8-4d91-acb8-10fddcb1b792 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:11.918657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b153a799-bdf8-4d91-acb8-10fddcb1b792 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:11.919463 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b153a799-bdf8-4d91-acb8-10fddcb1b792 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:12.187468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b153a799-bdf8-4d91-acb8-10fddcb1b792 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:12.196962 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b153a799-bdf8-4d91-acb8-10fddcb1b792 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1313 microversion: 2.1 time: 0.303215 Jun 16 16:15:12.198103 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 169/354] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:11 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:12.300108 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-81bb58b9-8a69-4fba-bfe9-8255549248f8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:12.302308 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-81bb58b9-8a69-4fba-bfe9-8255549248f8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:12.315261 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-81bb58b9-8a69-4fba-bfe9-8255549248f8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:12.317062 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-81bb58b9-8a69-4fba-bfe9-8255549248f8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:12.318589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-81bb58b9-8a69-4fba-bfe9-8255549248f8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:12.319440 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-81bb58b9-8a69-4fba-bfe9-8255549248f8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:12.634514 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-81bb58b9-8a69-4fba-bfe9-8255549248f8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:12.652756 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-81bb58b9-8a69-4fba-bfe9-8255549248f8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1365 microversion: 2.1 time: 0.359481 Jun 16 16:15:12.655977 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 170/355] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:12 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1365 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:12.916902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d203e3bb-1d8c-49f6-b203-4179a8494d2c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:12.926404 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d203e3bb-1d8c-49f6-b203-4179a8494d2c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:12.966700 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d203e3bb-1d8c-49f6-b203-4179a8494d2c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:12.967637 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d203e3bb-1d8c-49f6-b203-4179a8494d2c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:12.970441 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d203e3bb-1d8c-49f6-b203-4179a8494d2c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:12.971329 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d203e3bb-1d8c-49f6-b203-4179a8494d2c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:13.354230 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d203e3bb-1d8c-49f6-b203-4179a8494d2c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:13.371367 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d203e3bb-1d8c-49f6-b203-4179a8494d2c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.462741 Jun 16 16:15:13.394127 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 171/356] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:12 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:13.401891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1e0246e1-7d86-4823-9764-c327660991a6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:13.403240 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1e0246e1-7d86-4823-9764-c327660991a6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:13.412240 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1e0246e1-7d86-4823-9764-c327660991a6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:13.413167 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1e0246e1-7d86-4823-9764-c327660991a6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:13.416245 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1e0246e1-7d86-4823-9764-c327660991a6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:13.417109 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1e0246e1-7d86-4823-9764-c327660991a6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:13.667899 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1e0246e1-7d86-4823-9764-c327660991a6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:13.705452 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1e0246e1-7d86-4823-9764-c327660991a6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1313 microversion: 2.1 time: 0.309243 Jun 16 16:15:13.717963 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 172/357] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:13 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:13.726610 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-08a0c113-c991-4263-8741-544711153f4e req-8adceaa9-1c23-4f07-bbaf-ecb0a7dbc137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65f1126e-5b19-4b56-aa87-c4be0b53eb85", "name": "network-vif-plugged", "status": "completed", "tag": "1e1c5a67-e2e5-4c4d-9bb0-aaeddbf28281"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:13.741270 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-08a0c113-c991-4263-8741-544711153f4e req-8adceaa9-1c23-4f07-bbaf-ecb0a7dbc137 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:13.743590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-08a0c113-c991-4263-8741-544711153f4e req-8adceaa9-1c23-4f07-bbaf-ecb0a7dbc137 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:13.769721 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-08a0c113-c991-4263-8741-544711153f4e req-8adceaa9-1c23-4f07-bbaf-ecb0a7dbc137 service nova] Creating event network-vif-plugged:1e1c5a67-e2e5-4c4d-9bb0-aaeddbf28281 for instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 on hv-cinder-83716 Jun 16 16:15:13.779969 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-08a0c113-c991-4263-8741-544711153f4e req-8adceaa9-1c23-4f07-bbaf-ecb0a7dbc137 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069726 Jun 16 16:15:13.779969 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 173/358] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:13.790441 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-23e51974-c615-4b40-a6f8-a19ecb8965a5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:13.792069 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-23e51974-c615-4b40-a6f8-a19ecb8965a5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:13.803615 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-23e51974-c615-4b40-a6f8-a19ecb8965a5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:13.804955 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-23e51974-c615-4b40-a6f8-a19ecb8965a5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:13.806555 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-23e51974-c615-4b40-a6f8-a19ecb8965a5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:13.807339 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-23e51974-c615-4b40-a6f8-a19ecb8965a5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:13.864010 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=4 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:14.134999 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-23e51974-c615-4b40-a6f8-a19ecb8965a5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:14.154038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-23e51974-c615-4b40-a6f8-a19ecb8965a5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1365 microversion: 2.1 time: 0.366915 Jun 16 16:15:14.155964 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 174/359] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:13 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1365 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:14.409686 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-dc86bc51-0123-44b1-a334-a3955e9b4da8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:14.411546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-dc86bc51-0123-44b1-a334-a3955e9b4da8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:14.427817 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dc86bc51-0123-44b1-a334-a3955e9b4da8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:14.428683 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dc86bc51-0123-44b1-a334-a3955e9b4da8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:14.430601 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dc86bc51-0123-44b1-a334-a3955e9b4da8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:14.431404 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dc86bc51-0123-44b1-a334-a3955e9b4da8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:14.906603 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-dc86bc51-0123-44b1-a334-a3955e9b4da8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:14.930764 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-dc86bc51-0123-44b1-a334-a3955e9b4da8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.530026 Jun 16 16:15:14.943108 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 175/360] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:14 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:14.943108 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d1d517c6-c51e-4b07-a674-7efdd5165ba6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:14.956114 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d1d517c6-c51e-4b07-a674-7efdd5165ba6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:14.982723 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d1d517c6-c51e-4b07-a674-7efdd5165ba6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:14.983567 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d1d517c6-c51e-4b07-a674-7efdd5165ba6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:14.984937 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d1d517c6-c51e-4b07-a674-7efdd5165ba6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:14.985588 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d1d517c6-c51e-4b07-a674-7efdd5165ba6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:15.366424 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d1d517c6-c51e-4b07-a674-7efdd5165ba6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:15.389961 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d1d517c6-c51e-4b07-a674-7efdd5165ba6 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1498 microversion: 2.1 time: 0.456591 Jun 16 16:15:15.390949 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 176/361] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:14 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1498 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:15.402142 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3bc693e9-abe0-4503-a094-1240a2453c6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:15.403589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3bc693e9-abe0-4503-a094-1240a2453c6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:15.470285 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3bc693e9-abe0-4503-a094-1240a2453c6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:15.471002 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3bc693e9-abe0-4503-a094-1240a2453c6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:15.472469 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3bc693e9-abe0-4503-a094-1240a2453c6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:15.473142 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3bc693e9-abe0-4503-a094-1240a2453c6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:15.820306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3bc693e9-abe0-4503-a094-1240a2453c6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:15.851296 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3bc693e9-abe0-4503-a094-1240a2453c6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1365 microversion: 2.1 time: 0.458272 Jun 16 16:15:15.853757 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 177/362] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:15 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1365 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:15.959344 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-eaa4de91-bc48-49fd-ab75-792b07008cdc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:15.961688 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-eaa4de91-bc48-49fd-ab75-792b07008cdc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:15.975010 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-eaa4de91-bc48-49fd-ab75-792b07008cdc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:15.976768 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-eaa4de91-bc48-49fd-ab75-792b07008cdc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:15.978491 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-eaa4de91-bc48-49fd-ab75-792b07008cdc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:15.980196 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-eaa4de91-bc48-49fd-ab75-792b07008cdc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:16.226731 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-eaa4de91-bc48-49fd-ab75-792b07008cdc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:16.244496 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-eaa4de91-bc48-49fd-ab75-792b07008cdc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.293410 Jun 16 16:15:16.255381 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 178/363] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:15 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:16.521191 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3aef5b23-475d-48ac-9917-a75d8bb30b81 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:16.522680 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3aef5b23-475d-48ac-9917-a75d8bb30b81 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:16.533955 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3aef5b23-475d-48ac-9917-a75d8bb30b81 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:16.535189 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3aef5b23-475d-48ac-9917-a75d8bb30b81 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:16.537099 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3aef5b23-475d-48ac-9917-a75d8bb30b81 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:16.538405 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3aef5b23-475d-48ac-9917-a75d8bb30b81 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:16.622966 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3aef5b23-475d-48ac-9917-a75d8bb30b81 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Going to try to terminate instance {{(pid=117756) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:15:16.813893 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3aef5b23-475d-48ac-9917-a75d8bb30b81 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 204 len: 0 microversion: 2.1 time: 0.298450 Jun 16 16:15:16.818483 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 179/364] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:15:16 2022] DELETE /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:15:16.836268 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d5f8b20e-74f6-48e5-8832-94f25dbb0683 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:16.837144 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d5f8b20e-74f6-48e5-8832-94f25dbb0683 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:16.845481 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5f8b20e-74f6-48e5-8832-94f25dbb0683 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:16.846010 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5f8b20e-74f6-48e5-8832-94f25dbb0683 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:16.846890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5f8b20e-74f6-48e5-8832-94f25dbb0683 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:16.849885 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d5f8b20e-74f6-48e5-8832-94f25dbb0683 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:17.201783 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d5f8b20e-74f6-48e5-8832-94f25dbb0683 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:17.236509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d5f8b20e-74f6-48e5-8832-94f25dbb0683 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1504 microversion: 2.1 time: 0.408549 Jun 16 16:15:17.238137 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 180/365] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:16 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:17.248574 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-436f53c9-2c23-4341-9709-22e35f4a0983 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:17.249612 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-436f53c9-2c23-4341-9709-22e35f4a0983 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:17.260141 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-436f53c9-2c23-4341-9709-22e35f4a0983 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:17.261021 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-436f53c9-2c23-4341-9709-22e35f4a0983 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:17.262027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-436f53c9-2c23-4341-9709-22e35f4a0983 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:17.263569 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-436f53c9-2c23-4341-9709-22e35f4a0983 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:17.600376 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-436f53c9-2c23-4341-9709-22e35f4a0983 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:17.615343 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-436f53c9-2c23-4341-9709-22e35f4a0983 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1365 microversion: 2.1 time: 0.375475 Jun 16 16:15:17.616170 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 181/366] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:17 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1365 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:17.633497 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e0b6c4cb-4e40-4ed4-9d7f-5db52301abf9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:17.634144 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e0b6c4cb-4e40-4ed4-9d7f-5db52301abf9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:17.649885 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e0b6c4cb-4e40-4ed4-9d7f-5db52301abf9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:17.650687 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e0b6c4cb-4e40-4ed4-9d7f-5db52301abf9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:17.651659 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e0b6c4cb-4e40-4ed4-9d7f-5db52301abf9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:17.652264 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e0b6c4cb-4e40-4ed4-9d7f-5db52301abf9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:17.914038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e0b6c4cb-4e40-4ed4-9d7f-5db52301abf9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:17.918885 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:17.930591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e0b6c4cb-4e40-4ed4-9d7f-5db52301abf9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.310702 Jun 16 16:15:17.932140 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 182/367] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:17 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:18.266635 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1364c122-4b59-4ffe-a169-60b61fe4e0b4 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:18.268439 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1364c122-4b59-4ffe-a169-60b61fe4e0b4 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:18.280540 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1364c122-4b59-4ffe-a169-60b61fe4e0b4 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:18.288730 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1364c122-4b59-4ffe-a169-60b61fe4e0b4 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:18.290510 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1364c122-4b59-4ffe-a169-60b61fe4e0b4 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:18.291945 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1364c122-4b59-4ffe-a169-60b61fe4e0b4 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:18.546831 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1364c122-4b59-4ffe-a169-60b61fe4e0b4 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:18.564219 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1364c122-4b59-4ffe-a169-60b61fe4e0b4 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1504 microversion: 2.1 time: 0.301595 Jun 16 16:15:18.565976 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 183/368] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:18 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:18.652944 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c51d7d47-dc8c-47e5-a46e-1426bd54223a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:18.655532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c51d7d47-dc8c-47e5-a46e-1426bd54223a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:18.671877 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c51d7d47-dc8c-47e5-a46e-1426bd54223a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:18.676994 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c51d7d47-dc8c-47e5-a46e-1426bd54223a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:18.679932 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c51d7d47-dc8c-47e5-a46e-1426bd54223a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:18.681330 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c51d7d47-dc8c-47e5-a46e-1426bd54223a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:18.967472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c51d7d47-dc8c-47e5-a46e-1426bd54223a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:19.001676 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c51d7d47-dc8c-47e5-a46e-1426bd54223a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1365 microversion: 2.1 time: 0.369975 Jun 16 16:15:19.002616 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 184/369] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:18 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1365 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:19.009165 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-03b2a8a9-680f-492a-9cfd-0b63aa8d5a4e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:19.009165 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-03b2a8a9-680f-492a-9cfd-0b63aa8d5a4e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:19.016483 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-03b2a8a9-680f-492a-9cfd-0b63aa8d5a4e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:19.017063 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-03b2a8a9-680f-492a-9cfd-0b63aa8d5a4e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:19.017890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-03b2a8a9-680f-492a-9cfd-0b63aa8d5a4e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:19.018396 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-03b2a8a9-680f-492a-9cfd-0b63aa8d5a4e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:19.144411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:19.395829 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-03b2a8a9-680f-492a-9cfd-0b63aa8d5a4e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:19.410513 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-03b2a8a9-680f-492a-9cfd-0b63aa8d5a4e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.406282 Jun 16 16:15:19.412084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 185/370] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:19 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:19.591843 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fab827d8-3368-4f1a-afe6-25dd8ed77f06 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:19.593430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-fab827d8-3368-4f1a-afe6-25dd8ed77f06 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:19.609039 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fab827d8-3368-4f1a-afe6-25dd8ed77f06 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:19.609524 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fab827d8-3368-4f1a-afe6-25dd8ed77f06 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:19.609814 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:19.610515 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fab827d8-3368-4f1a-afe6-25dd8ed77f06 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:19.610997 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fab827d8-3368-4f1a-afe6-25dd8ed77f06 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:19.879916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fab827d8-3368-4f1a-afe6-25dd8ed77f06 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:19.903474 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fab827d8-3368-4f1a-afe6-25dd8ed77f06 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1504 microversion: 2.1 time: 0.319122 Jun 16 16:15:19.904770 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 186/371] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:19 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1504 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:20.033156 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fa2347e8-e6f8-46b4-a2f0-242cc6be1059 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:20.034010 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-fa2347e8-e6f8-46b4-a2f0-242cc6be1059 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:20.047528 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fa2347e8-e6f8-46b4-a2f0-242cc6be1059 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:20.048686 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fa2347e8-e6f8-46b4-a2f0-242cc6be1059 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:20.050064 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fa2347e8-e6f8-46b4-a2f0-242cc6be1059 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:20.050812 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fa2347e8-e6f8-46b4-a2f0-242cc6be1059 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:20.513522 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fa2347e8-e6f8-46b4-a2f0-242cc6be1059 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:20.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fa2347e8-e6f8-46b4-a2f0-242cc6be1059 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1554 microversion: 2.1 time: 0.531869 Jun 16 16:15:20.572884 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 187/372] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:20 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1554 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:20.572884 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-9f913fd9-21e6-4121-a07c-d1ef8e4d2568 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:20.572884 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-9f913fd9-21e6-4121-a07c-d1ef8e4d2568 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:20.581606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9f913fd9-21e6-4121-a07c-d1ef8e4d2568 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:20.582423 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9f913fd9-21e6-4121-a07c-d1ef8e4d2568 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:20.584605 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9f913fd9-21e6-4121-a07c-d1ef8e4d2568 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:20.584605 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9f913fd9-21e6-4121-a07c-d1ef8e4d2568 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:20.996641 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-9f913fd9-21e6-4121-a07c-d1ef8e4d2568 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:21.015121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-9f913fd9-21e6-4121-a07c-d1ef8e4d2568 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.453692 Jun 16 16:15:21.016576 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 188/373] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:20 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:21.045873 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e1872678-ea01-4972-8000-89ad4ea916f2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:21.046956 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e1872678-ea01-4972-8000-89ad4ea916f2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:21.058507 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1872678-ea01-4972-8000-89ad4ea916f2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:21.059295 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1872678-ea01-4972-8000-89ad4ea916f2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:21.060731 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1872678-ea01-4972-8000-89ad4ea916f2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:21.061554 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1872678-ea01-4972-8000-89ad4ea916f2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:21.251874 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e1872678-ea01-4972-8000-89ad4ea916f2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.223652 Jun 16 16:15:21.253675 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 189/374] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 16:15:21 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:21.270588 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a675775e-b4bb-4b40-92ca-62a4ebd4a366 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:21.271706 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a675775e-b4bb-4b40-92ca-62a4ebd4a366 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:21.301489 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a675775e-b4bb-4b40-92ca-62a4ebd4a366 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:21.302482 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a675775e-b4bb-4b40-92ca-62a4ebd4a366 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:21.304927 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a675775e-b4bb-4b40-92ca-62a4ebd4a366 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:21.305684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a675775e-b4bb-4b40-92ca-62a4ebd4a366 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:21.434838 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] validate_networks() for [('84d0c54c-ef5a-4a19-a82f-2cbc7460411e', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:15:22.087232 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a675775e-b4bb-4b40-92ca-62a4ebd4a366 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:22.099980 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a675775e-b4bb-4b40-92ca-62a4ebd4a366 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1504 microversion: 2.1 time: 0.835358 Jun 16 16:15:22.110939 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:15:22.110939 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:15:22.110939 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:15:22.110939 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:15:22.110939 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:15:22.112550 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 190/375] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:21 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1504 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:22.118611 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a3bec76a-3df2-4327-8e70-a7bd730b6f95 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Action: 'create', calling method: .version_select at 0x7f38c1ee23a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1233643166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVV/J25q9uFujvtzMK+EGHLS65F/Lfsm6iyYLOkpZmYbys4tejkVwBVtPo26ewCm3kMgivHeIXJ6xIW3eDCutg/udDuM9pq+nSeZqs8Y0sH+pCMqFmfZyFM3Q/X7oxPdg=="}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:22.134660 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:22.135642 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:22.137392 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:22.138004 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:22.145943 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-a3bec76a-3df2-4327-8e70-a7bd730b6f95 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Getting quotas for project 925cc45674694931bfe8fc60765045c2. Resources: {'key_pairs'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:15:22.156451 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-a3bec76a-3df2-4327-8e70-a7bd730b6f95 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Getting quotas for user c0da50b34820422193be2b06e0da2837 and project 925cc45674694931bfe8fc60765045c2. Resources: {'key_pairs'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:15:22.167284 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Getting quotas for project 6eee49063a5847dba6ffb520d0149d88. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:15:22.172684 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Getting quotas for user 515114f0a842463fb2d1265ee33db8eb and project 6eee49063a5847dba6ffb520d0149d88. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:15:22.188723 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:15:22.191348 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:15:22.195814 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a3bec76a-3df2-4327-8e70-a7bd730b6f95 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.080819 Jun 16 16:15:22.196759 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 191/376] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 16:15:22 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:22.205603 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-a4d476ed-4359-4df2-be2d-5a08d229bd99 req-30a25858-0393-4598-bb92-45ae4f140b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3", "name": "network-vif-deleted", "tag": "7bbaaa0e-42ee-4dab-b7e9-1093b4d31756"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:22.224475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-a4d476ed-4359-4df2-be2d-5a08d229bd99 req-30a25858-0393-4598-bb92-45ae4f140b47 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:22.225683 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-a4d476ed-4359-4df2-be2d-5a08d229bd99 req-30a25858-0393-4598-bb92-45ae4f140b47 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:22.246922 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-a4d476ed-4359-4df2-be2d-5a08d229bd99 req-30a25858-0393-4598-bb92-45ae4f140b47 service nova] Creating event network-vif-deleted:7bbaaa0e-42ee-4dab-b7e9-1093b4d31756 for instance b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 on hv-cinder-83716 Jun 16 16:15:22.255148 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-a4d476ed-4359-4df2-be2d-5a08d229bd99 req-30a25858-0393-4598-bb92-45ae4f140b47 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056233 Jun 16 16:15:22.255805 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 192/377] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:22.264429 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c808a6be-0196-4291-90c0-427aa6d71f05 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:22.265177 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c808a6be-0196-4291-90c0-427aa6d71f05 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:22.274689 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c808a6be-0196-4291-90c0-427aa6d71f05 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:22.275478 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c808a6be-0196-4291-90c0-427aa6d71f05 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:22.277348 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c808a6be-0196-4291-90c0-427aa6d71f05 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:22.278929 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c808a6be-0196-4291-90c0-427aa6d71f05 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:22.322095 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ed8eb29b-dbd9-48b0-a3c8-f60f9c1291d5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 12.741005 Jun 16 16:15:22.323274 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 186/378] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:15:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 12748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:15:22.345025 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c7805c71-6b5f-4dbf-b6db-0a2db45cea13 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:22.346944 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c7805c71-6b5f-4dbf-b6db-0a2db45cea13 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:22.441907 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c7805c71-6b5f-4dbf-b6db-0a2db45cea13 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:22.449885 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c7805c71-6b5f-4dbf-b6db-0a2db45cea13 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1246 microversion: 2.1 time: 0.114736 Jun 16 16:15:22.450495 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 187/379] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:22 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1246 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:22.465422 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1992818075", "imageRef": "d84ec6a4-48ac-4a63-95bb-25d7f8481861", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1233643166", "networks": [{"uuid": "1a047fbf-e261-4245-b980-32955ab86d94"}]}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:22.533807 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] validate_networks() for [('1a047fbf-e261-4245-b980-32955ab86d94', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:15:22.770627 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c808a6be-0196-4291-90c0-427aa6d71f05 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:22.801559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c808a6be-0196-4291-90c0-427aa6d71f05 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.540832 Jun 16 16:15:22.815132 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 193/380] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:22 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:23.083579 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:15:23.084263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:15:23.084951 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:15:23.086225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:15:23.086660 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:15:23.097146 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:23.097866 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:23.098889 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:23.099517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:23.120834 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Getting quotas for project 925cc45674694931bfe8fc60765045c2. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:15:23.121331 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1904fbdb-8754-43bb-bff4-563d6d38d9ba tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:23.123463 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1904fbdb-8754-43bb-bff4-563d6d38d9ba tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:23.129419 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Getting quotas for user c0da50b34820422193be2b06e0da2837 and project 925cc45674694931bfe8fc60765045c2. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:15:23.133297 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1904fbdb-8754-43bb-bff4-563d6d38d9ba tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:23.134309 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1904fbdb-8754-43bb-bff4-563d6d38d9ba tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:23.135887 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1904fbdb-8754-43bb-bff4-563d6d38d9ba tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:23.136472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1904fbdb-8754-43bb-bff4-563d6d38d9ba tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:23.152382 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:15:23.156533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d84ec6a4-48ac-4a63-95bb-25d7f8481861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:15:23.182942 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1904fbdb-8754-43bb-bff4-563d6d38d9ba tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:23.183703 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1904fbdb-8754-43bb-bff4-563d6d38d9ba tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:23.184151 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-1904fbdb-8754-43bb-bff4-563d6d38d9ba tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lazy-loading 'fault' on Instance uuid b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:15:23.221806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9118a91d-f54b-4911-a2a0-840719633c00 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760133 Jun 16 16:15:23.223416 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 188/381] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:15:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:15:23.237829 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5574d831-551e-429b-8427-3d41917f2eba tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:23.239372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5574d831-551e-429b-8427-3d41917f2eba tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:23.243193 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1904fbdb-8754-43bb-bff4-563d6d38d9ba tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:23.254504 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1904fbdb-8754-43bb-bff4-563d6d38d9ba tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1303 microversion: 2.1 time: 0.139505 Jun 16 16:15:23.255657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 194/382] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:23 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:23.320021 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5574d831-551e-429b-8427-3d41917f2eba tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:23.328601 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5574d831-551e-429b-8427-3d41917f2eba tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1259 microversion: 2.1 time: 0.097479 Jun 16 16:15:23.329835 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 189/383] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:23 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1259 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:23.472144 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a37ebb22-af34-4e8e-a5d9-3790110c3d23 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:23.473489 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a37ebb22-af34-4e8e-a5d9-3790110c3d23 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:23.483941 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a37ebb22-af34-4e8e-a5d9-3790110c3d23 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:23.483941 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a37ebb22-af34-4e8e-a5d9-3790110c3d23 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:23.483941 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a37ebb22-af34-4e8e-a5d9-3790110c3d23 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:23.484584 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a37ebb22-af34-4e8e-a5d9-3790110c3d23 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:23.619124 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a37ebb22-af34-4e8e-a5d9-3790110c3d23 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:23.630526 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a37ebb22-af34-4e8e-a5d9-3790110c3d23 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1250 microversion: 2.1 time: 0.165925 Jun 16 16:15:23.631262 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 195/384] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:23 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1250 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:23.827657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d38794b6-7ef7-4cfc-8b89-2142710928e7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:23.828524 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d38794b6-7ef7-4cfc-8b89-2142710928e7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:23.838098 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d38794b6-7ef7-4cfc-8b89-2142710928e7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:23.839023 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d38794b6-7ef7-4cfc-8b89-2142710928e7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:23.840819 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d38794b6-7ef7-4cfc-8b89-2142710928e7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:23.840819 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d38794b6-7ef7-4cfc-8b89-2142710928e7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:24.025162 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d38794b6-7ef7-4cfc-8b89-2142710928e7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:24.033619 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d38794b6-7ef7-4cfc-8b89-2142710928e7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.210420 Jun 16 16:15:24.034448 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 190/385] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:23 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:24.277949 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-17d90cbe-9e20-4a5b-a01f-3e3cd0c0fb58 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:24.278573 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-17d90cbe-9e20-4a5b-a01f-3e3cd0c0fb58 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:24.285645 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-17d90cbe-9e20-4a5b-a01f-3e3cd0c0fb58 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:24.286139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-17d90cbe-9e20-4a5b-a01f-3e3cd0c0fb58 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:24.286936 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-17d90cbe-9e20-4a5b-a01f-3e3cd0c0fb58 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:24.287570 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-17d90cbe-9e20-4a5b-a01f-3e3cd0c0fb58 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:24.327128 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-17d90cbe-9e20-4a5b-a01f-3e3cd0c0fb58 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:24.327569 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-17d90cbe-9e20-4a5b-a01f-3e3cd0c0fb58 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:24.328025 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-17d90cbe-9e20-4a5b-a01f-3e3cd0c0fb58 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lazy-loading 'fault' on Instance uuid b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:15:24.375283 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-70f6568d-c209-4a73-b3df-12c3c7e26468 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:24.376485 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-70f6568d-c209-4a73-b3df-12c3c7e26468 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:24.386456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-70f6568d-c209-4a73-b3df-12c3c7e26468 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:24.386914 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-70f6568d-c209-4a73-b3df-12c3c7e26468 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:24.387743 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-70f6568d-c209-4a73-b3df-12c3c7e26468 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:24.388190 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-70f6568d-c209-4a73-b3df-12c3c7e26468 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:24.426717 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-17d90cbe-9e20-4a5b-a01f-3e3cd0c0fb58 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:24.435379 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-17d90cbe-9e20-4a5b-a01f-3e3cd0c0fb58 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1303 microversion: 2.1 time: 0.162577 Jun 16 16:15:24.435966 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 196/386] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:24 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1303 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:24.448135 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-bf656f0e-a599-4ac2-b899-27017293b877 req-bbe44677-ee44-4344-8258-a10ae4b49098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f1126e-5b19-4b56-aa87-c4be0b53eb85", "tag": "1e1c5a67-e2e5-4c4d-9bb0-aaeddbf28281"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:24.466006 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-bf656f0e-a599-4ac2-b899-27017293b877 req-bbe44677-ee44-4344-8258-a10ae4b49098 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:24.466953 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-bf656f0e-a599-4ac2-b899-27017293b877 req-bbe44677-ee44-4344-8258-a10ae4b49098 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:24.484933 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-70f6568d-c209-4a73-b3df-12c3c7e26468 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:24.490169 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-bf656f0e-a599-4ac2-b899-27017293b877 req-bbe44677-ee44-4344-8258-a10ae4b49098 service nova] Creating event network-changed:1e1c5a67-e2e5-4c4d-9bb0-aaeddbf28281 for instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 on hv-cinder-83716 Jun 16 16:15:24.495586 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-70f6568d-c209-4a73-b3df-12c3c7e26468 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1263 microversion: 2.1 time: 0.139908 Jun 16 16:15:24.496383 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 191/387] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:24 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1263 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:24.500616 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-bf656f0e-a599-4ac2-b899-27017293b877 req-bbe44677-ee44-4344-8258-a10ae4b49098 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062828 Jun 16 16:15:24.501297 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 197/388] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:24.651752 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e2d769ba-bc5f-419c-a269-941883628cec tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:24.652371 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e2d769ba-bc5f-419c-a269-941883628cec tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:24.658645 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2d769ba-bc5f-419c-a269-941883628cec tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:24.659101 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2d769ba-bc5f-419c-a269-941883628cec tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:24.659887 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2d769ba-bc5f-419c-a269-941883628cec tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:24.660351 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e2d769ba-bc5f-419c-a269-941883628cec tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:24.725024 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e2d769ba-bc5f-419c-a269-941883628cec tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:24.733333 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e2d769ba-bc5f-419c-a269-941883628cec tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1250 microversion: 2.1 time: 0.085940 Jun 16 16:15:24.733919 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 192/389] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:24 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1250 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:25.058776 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-aab32178-4cf7-40ee-89c0-9185933b6d32 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:25.059606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-aab32178-4cf7-40ee-89c0-9185933b6d32 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:25.067123 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aab32178-4cf7-40ee-89c0-9185933b6d32 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:25.067577 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aab32178-4cf7-40ee-89c0-9185933b6d32 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:25.068363 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aab32178-4cf7-40ee-89c0-9185933b6d32 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:25.068981 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aab32178-4cf7-40ee-89c0-9185933b6d32 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:25.248049 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-aab32178-4cf7-40ee-89c0-9185933b6d32 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:25.286806 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-aab32178-4cf7-40ee-89c0-9185933b6d32 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.232428 Jun 16 16:15:25.299202 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 198/390] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:25 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:25.460751 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-43b4aed0-7ab7-4754-90ff-b05ecca3d081 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:25.461783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-43b4aed0-7ab7-4754-90ff-b05ecca3d081 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:25.473229 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43b4aed0-7ab7-4754-90ff-b05ecca3d081 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:25.473676 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43b4aed0-7ab7-4754-90ff-b05ecca3d081 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:25.474511 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43b4aed0-7ab7-4754-90ff-b05ecca3d081 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:25.474949 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43b4aed0-7ab7-4754-90ff-b05ecca3d081 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:25.515856 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43b4aed0-7ab7-4754-90ff-b05ecca3d081 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:25.516334 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43b4aed0-7ab7-4754-90ff-b05ecca3d081 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:25.516547 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ced574e1-a72a-424a-b8dd-da837c1dd95b tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:25.516780 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-43b4aed0-7ab7-4754-90ff-b05ecca3d081 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lazy-loading 'fault' on Instance uuid b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:15:25.517324 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ced574e1-a72a-424a-b8dd-da837c1dd95b tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:25.520279 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:25.527509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ced574e1-a72a-424a-b8dd-da837c1dd95b tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:25.528238 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ced574e1-a72a-424a-b8dd-da837c1dd95b tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:25.529612 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ced574e1-a72a-424a-b8dd-da837c1dd95b tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:25.530429 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ced574e1-a72a-424a-b8dd-da837c1dd95b tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:25.580934 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-43b4aed0-7ab7-4754-90ff-b05ecca3d081 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:25.602058 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-43b4aed0-7ab7-4754-90ff-b05ecca3d081 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1303 microversion: 2.1 time: 0.147026 Jun 16 16:15:25.603156 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 193/391] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:25 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1303 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:25.636098 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ced574e1-a72a-424a-b8dd-da837c1dd95b tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:25.650035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ced574e1-a72a-424a-b8dd-da837c1dd95b tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1263 microversion: 2.1 time: 0.139298 Jun 16 16:15:25.650992 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 199/392] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:25 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1263 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:25.753542 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ce5c8fbd-a20b-442f-9dd9-d2926df6b31d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:25.754227 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ce5c8fbd-a20b-442f-9dd9-d2926df6b31d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:25.765092 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce5c8fbd-a20b-442f-9dd9-d2926df6b31d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:25.765920 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce5c8fbd-a20b-442f-9dd9-d2926df6b31d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:25.768919 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce5c8fbd-a20b-442f-9dd9-d2926df6b31d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:25.770028 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce5c8fbd-a20b-442f-9dd9-d2926df6b31d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:25.923463 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ce5c8fbd-a20b-442f-9dd9-d2926df6b31d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:25.951755 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ce5c8fbd-a20b-442f-9dd9-d2926df6b31d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1250 microversion: 2.1 time: 0.202925 Jun 16 16:15:25.954998 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 194/393] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:25 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1250 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:26.312954 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-182a69f3-a92a-4efe-b590-1073fc6269c5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:26.314001 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-182a69f3-a92a-4efe-b590-1073fc6269c5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:26.322883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-182a69f3-a92a-4efe-b590-1073fc6269c5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:26.323343 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-182a69f3-a92a-4efe-b590-1073fc6269c5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:26.324144 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-182a69f3-a92a-4efe-b590-1073fc6269c5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:26.324577 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-182a69f3-a92a-4efe-b590-1073fc6269c5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:26.579831 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-182a69f3-a92a-4efe-b590-1073fc6269c5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:26.599371 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-182a69f3-a92a-4efe-b590-1073fc6269c5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.290259 Jun 16 16:15:26.601271 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 200/394] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:26 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:26.626427 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9815c0d5-82fd-45d3-88fd-179429dee719 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:26.627739 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9815c0d5-82fd-45d3-88fd-179429dee719 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:26.638993 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9815c0d5-82fd-45d3-88fd-179429dee719 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:26.640798 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9815c0d5-82fd-45d3-88fd-179429dee719 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:26.642505 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9815c0d5-82fd-45d3-88fd-179429dee719 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:26.643539 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9815c0d5-82fd-45d3-88fd-179429dee719 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:26.669881 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4e950fe6-c5e7-46c5-a369-e2ef25e8fd09 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:26.670525 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4e950fe6-c5e7-46c5-a369-e2ef25e8fd09 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:26.677960 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4e950fe6-c5e7-46c5-a369-e2ef25e8fd09 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:26.678427 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4e950fe6-c5e7-46c5-a369-e2ef25e8fd09 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:26.679346 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4e950fe6-c5e7-46c5-a369-e2ef25e8fd09 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:26.680099 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4e950fe6-c5e7-46c5-a369-e2ef25e8fd09 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:26.698817 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9815c0d5-82fd-45d3-88fd-179429dee719 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:26.699385 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9815c0d5-82fd-45d3-88fd-179429dee719 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:26.700225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-9815c0d5-82fd-45d3-88fd-179429dee719 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lazy-loading 'fault' on Instance uuid b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:15:26.705320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=100 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:26.766086 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4e950fe6-c5e7-46c5-a369-e2ef25e8fd09 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:26.776056 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4e950fe6-c5e7-46c5-a369-e2ef25e8fd09 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1311 microversion: 2.1 time: 0.110204 Jun 16 16:15:26.782476 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9815c0d5-82fd-45d3-88fd-179429dee719 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246ac84c69894c08b870c4579cabd042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4ba60390dd4354b869bb227ef030b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:26.787736 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 201/395] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:26 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1311 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:26.794264 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9815c0d5-82fd-45d3-88fd-179429dee719 tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 200 len: 1303 microversion: 2.1 time: 0.172444 Jun 16 16:15:26.795029 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 195/396] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:26 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 1303 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:26.985486 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-577a5da9-d529-4835-93d0-40eaa8d6ae0f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:26.986225 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-577a5da9-d529-4835-93d0-40eaa8d6ae0f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:26.995383 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-577a5da9-d529-4835-93d0-40eaa8d6ae0f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:26.996161 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-577a5da9-d529-4835-93d0-40eaa8d6ae0f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:26.996967 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-577a5da9-d529-4835-93d0-40eaa8d6ae0f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:26.997406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-577a5da9-d529-4835-93d0-40eaa8d6ae0f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:27.090933 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-577a5da9-d529-4835-93d0-40eaa8d6ae0f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:27.101805 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-577a5da9-d529-4835-93d0-40eaa8d6ae0f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1298 microversion: 2.1 time: 0.120184 Jun 16 16:15:27.102585 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 202/397] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:26 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1298 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:27.622980 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2f98ecdb-4680-4dfd-8d1d-20e086333881 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:27.623600 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2f98ecdb-4680-4dfd-8d1d-20e086333881 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:27.629963 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2f98ecdb-4680-4dfd-8d1d-20e086333881 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:27.630904 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2f98ecdb-4680-4dfd-8d1d-20e086333881 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:27.631182 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2f98ecdb-4680-4dfd-8d1d-20e086333881 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:27.631621 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2f98ecdb-4680-4dfd-8d1d-20e086333881 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:27.797303 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7449eecb-adf9-4656-aed2-038d1e34c730 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:27.798177 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7449eecb-adf9-4656-aed2-038d1e34c730 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:27.807055 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7449eecb-adf9-4656-aed2-038d1e34c730 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:27.808113 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7449eecb-adf9-4656-aed2-038d1e34c730 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:27.808725 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7449eecb-adf9-4656-aed2-038d1e34c730 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:27.809321 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7449eecb-adf9-4656-aed2-038d1e34c730 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:27.828919 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2f98ecdb-4680-4dfd-8d1d-20e086333881 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:27.849053 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2f98ecdb-4680-4dfd-8d1d-20e086333881 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.231432 Jun 16 16:15:27.850176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 196/398] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:27 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:27.859543 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bb57d3c6-bb54-4ae0-8485-f73ac8ff278b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:27.860725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bb57d3c6-bb54-4ae0-8485-f73ac8ff278b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] [instance: b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:27.879856 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb57d3c6-bb54-4ae0-8485-f73ac8ff278b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:27.880628 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb57d3c6-bb54-4ae0-8485-f73ac8ff278b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:27.881586 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb57d3c6-bb54-4ae0-8485-f73ac8ff278b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:27.882164 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb57d3c6-bb54-4ae0-8485-f73ac8ff278b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:27.902517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-bb57d3c6-bb54-4ae0-8485-f73ac8ff278b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] HTTP exception thrown: Instance b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 could not be found. Jun 16 16:15:27.904058 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7449eecb-adf9-4656-aed2-038d1e34c730 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bb57d3c6-bb54-4ae0-8485-f73ac8ff278b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Request method failure captured: Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 HTTP/1.1 Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1a6WNBJvkwpZwwtBx1AoadtL_VsFSyPCcMANUvP_Xk1NL_ct4DPy_-J_AOqJxGtqR9y2cXCA-jVN-bziIJT2Od5b-XrVZXOATSYSmBwKVGs2kOVF7t6OVT9Yl8-swv6x0spBGgs-UuLXsCRxJXUE6KnUWrcmOngnvqQuDMB66-nfcI Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 7b4ba60390dd4354b869bb227ef030b6 Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-VolumesActionsTest-1659229132 Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:15:27.905456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:15:27.907080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7b4ba60390dd4354b869bb227ef030b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b4ba60390dd4354b869bb227ef030b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7b4ba60390dd4354b869bb227ef030b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b4ba60390dd4354b869bb227ef030b6"}]}] Jun 16 16:15:27.907080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-VolumesActionsTest-1659229132 Jun 16 16:15:27.907080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 7b4ba60390dd4354b869bb227ef030b6 Jun 16 16:15:27.907080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-VolumesActionsTest-1659229132 Jun 16 16:15:27.907080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-VolumesActionsTest-1659229132-project Jun 16 16:15:27.907080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:15:27.907080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:15:27.907080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 246ac84c69894c08b870c4579cabd042 Jun 16 16:15:27.907080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-VolumesActionsTest-1659229132-project Jun 16 16:15:27.907080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:15:27.907080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 could not be found. Jun 16 16:15:27.907080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': 'b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3'} Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 could not be found. Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:15:27.907945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 could not be found. Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 could not be found. Jun 16 16:15:27.910048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:15:27.912178 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bb57d3c6-bb54-4ae0-8485-f73ac8ff278b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] Returning 404 to user: Instance b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:15:27.912178 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bb57d3c6-bb54-4ae0-8485-f73ac8ff278b tempest-VolumesActionsTest-1659229132 tempest-VolumesActionsTest-1659229132-project] 10.222.0.17 "GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3" status: 404 len: 111 microversion: 2.1 time: 0.055307 Jun 16 16:15:27.912178 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 197/399] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:27 2022] GET /compute/v2.1/servers/b8c40261-3d5c-4d4c-83fe-4350f9ba4cd3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:15:27.920762 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7449eecb-adf9-4656-aed2-038d1e34c730 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1311 microversion: 2.1 time: 0.129067 Jun 16 16:15:27.931375 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 203/400] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:27 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1311 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:28.121684 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bda50675-216c-47ff-baf6-571e36a6ba20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:28.122534 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bda50675-216c-47ff-baf6-571e36a6ba20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:28.133919 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bda50675-216c-47ff-baf6-571e36a6ba20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:28.134403 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bda50675-216c-47ff-baf6-571e36a6ba20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:28.135377 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bda50675-216c-47ff-baf6-571e36a6ba20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:28.135802 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bda50675-216c-47ff-baf6-571e36a6ba20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:28.233396 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bda50675-216c-47ff-baf6-571e36a6ba20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:28.251084 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bda50675-216c-47ff-baf6-571e36a6ba20 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1298 microversion: 2.1 time: 0.135295 Jun 16 16:15:28.252283 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 198/401] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:28 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1298 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:28.871039 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e6d08f08-0732-4cf4-a1f5-08c5fea91655 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:28.871745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e6d08f08-0732-4cf4-a1f5-08c5fea91655 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:28.879411 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e6d08f08-0732-4cf4-a1f5-08c5fea91655 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:28.879863 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e6d08f08-0732-4cf4-a1f5-08c5fea91655 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:28.880651 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e6d08f08-0732-4cf4-a1f5-08c5fea91655 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:28.881088 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e6d08f08-0732-4cf4-a1f5-08c5fea91655 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:28.937826 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-dcb9223f-11fe-4749-8a85-0813b74036e2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:28.938491 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-dcb9223f-11fe-4749-8a85-0813b74036e2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:28.946434 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dcb9223f-11fe-4749-8a85-0813b74036e2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:28.947142 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dcb9223f-11fe-4749-8a85-0813b74036e2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:28.947927 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dcb9223f-11fe-4749-8a85-0813b74036e2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:28.948369 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dcb9223f-11fe-4749-8a85-0813b74036e2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:29.026198 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-dcb9223f-11fe-4749-8a85-0813b74036e2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:29.035359 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-dcb9223f-11fe-4749-8a85-0813b74036e2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1311 microversion: 2.1 time: 0.101419 Jun 16 16:15:29.036316 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 199/402] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:28 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:29.271306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e6d08f08-0732-4cf4-a1f5-08c5fea91655 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:29.277605 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4b4c67c6-c76f-4b2a-9fb9-d40f2113f99b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:29.282796 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4b4c67c6-c76f-4b2a-9fb9-d40f2113f99b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:29.284137 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e6d08f08-0732-4cf4-a1f5-08c5fea91655 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.417355 Jun 16 16:15:29.284892 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 204/403] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:28 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:29.289169 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4b4c67c6-c76f-4b2a-9fb9-d40f2113f99b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:29.289733 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4b4c67c6-c76f-4b2a-9fb9-d40f2113f99b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:29.290756 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4b4c67c6-c76f-4b2a-9fb9-d40f2113f99b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:29.291290 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4b4c67c6-c76f-4b2a-9fb9-d40f2113f99b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:29.369615 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4b4c67c6-c76f-4b2a-9fb9-d40f2113f99b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:29.377881 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4b4c67c6-c76f-4b2a-9fb9-d40f2113f99b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1298 microversion: 2.1 time: 0.105639 Jun 16 16:15:29.378497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 200/404] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:29 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:30.057657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1973634a-f139-4a4d-a573-1744d1cf73ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:30.059278 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1973634a-f139-4a4d-a573-1744d1cf73ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:30.070314 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1973634a-f139-4a4d-a573-1744d1cf73ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:30.071395 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1973634a-f139-4a4d-a573-1744d1cf73ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:30.072985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1973634a-f139-4a4d-a573-1744d1cf73ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:30.074121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1973634a-f139-4a4d-a573-1744d1cf73ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:30.190299 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1973634a-f139-4a4d-a573-1744d1cf73ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:30.199806 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1973634a-f139-4a4d-a573-1744d1cf73ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1311 microversion: 2.1 time: 0.147662 Jun 16 16:15:30.200435 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 205/405] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:30 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1311 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:30.303844 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2d2d16ae-43f6-4d56-84da-9799ef65963a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:30.304506 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2d2d16ae-43f6-4d56-84da-9799ef65963a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:30.312052 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2d2d16ae-43f6-4d56-84da-9799ef65963a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:30.312539 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2d2d16ae-43f6-4d56-84da-9799ef65963a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:30.313358 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2d2d16ae-43f6-4d56-84da-9799ef65963a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:30.313821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2d2d16ae-43f6-4d56-84da-9799ef65963a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:30.397584 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6cd6fd64-bc70-4329-9b80-f7fd560d4d0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:30.398768 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6cd6fd64-bc70-4329-9b80-f7fd560d4d0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:30.405620 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6cd6fd64-bc70-4329-9b80-f7fd560d4d0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:30.406263 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6cd6fd64-bc70-4329-9b80-f7fd560d4d0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:30.406885 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6cd6fd64-bc70-4329-9b80-f7fd560d4d0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:30.407331 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6cd6fd64-bc70-4329-9b80-f7fd560d4d0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:30.497285 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2d2d16ae-43f6-4d56-84da-9799ef65963a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:30.520394 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2d2d16ae-43f6-4d56-84da-9799ef65963a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.220807 Jun 16 16:15:30.521411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 201/406] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:30 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:30.532813 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6cd6fd64-bc70-4329-9b80-f7fd560d4d0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:30.550520 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6cd6fd64-bc70-4329-9b80-f7fd560d4d0c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1306 microversion: 2.1 time: 0.156508 Jun 16 16:15:30.551548 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 206/407] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:30 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1306 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:31.218707 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-50fb9b5f-564f-457a-8768-1f8547d3d9b4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:31.219319 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-50fb9b5f-564f-457a-8768-1f8547d3d9b4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:31.226094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-50fb9b5f-564f-457a-8768-1f8547d3d9b4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:31.226549 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-50fb9b5f-564f-457a-8768-1f8547d3d9b4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:31.227332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-50fb9b5f-564f-457a-8768-1f8547d3d9b4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:31.227795 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-50fb9b5f-564f-457a-8768-1f8547d3d9b4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:31.293339 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-50fb9b5f-564f-457a-8768-1f8547d3d9b4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:31.301021 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-50fb9b5f-564f-457a-8768-1f8547d3d9b4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1329 microversion: 2.1 time: 0.086213 Jun 16 16:15:31.301603 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 202/408] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:31 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1329 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:31.541712 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3a3c819f-49ce-477e-b6f1-4e168d2c21e4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:31.542497 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3a3c819f-49ce-477e-b6f1-4e168d2c21e4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:31.550048 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3a3c819f-49ce-477e-b6f1-4e168d2c21e4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:31.550512 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3a3c819f-49ce-477e-b6f1-4e168d2c21e4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:31.551297 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3a3c819f-49ce-477e-b6f1-4e168d2c21e4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:31.551746 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3a3c819f-49ce-477e-b6f1-4e168d2c21e4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:31.576160 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4131f085-2a9a-4764-8e12-fb292f016e66 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:31.576843 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4131f085-2a9a-4764-8e12-fb292f016e66 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:31.583015 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4131f085-2a9a-4764-8e12-fb292f016e66 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:31.583461 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4131f085-2a9a-4764-8e12-fb292f016e66 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:31.584231 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4131f085-2a9a-4764-8e12-fb292f016e66 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:31.584657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4131f085-2a9a-4764-8e12-fb292f016e66 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:31.651622 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4131f085-2a9a-4764-8e12-fb292f016e66 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:31.659328 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4131f085-2a9a-4764-8e12-fb292f016e66 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1304 microversion: 2.1 time: 0.087011 Jun 16 16:15:31.659898 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 203/409] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:31 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1304 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:31.702254 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3a3c819f-49ce-477e-b6f1-4e168d2c21e4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:31.711508 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3a3c819f-49ce-477e-b6f1-4e168d2c21e4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.173974 Jun 16 16:15:31.712089 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 207/410] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:31 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:32.320217 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-29d2e9e8-32df-433a-8171-145fb6a81c42 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:32.320837 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-29d2e9e8-32df-433a-8171-145fb6a81c42 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:32.327640 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-29d2e9e8-32df-433a-8171-145fb6a81c42 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:32.328095 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-29d2e9e8-32df-433a-8171-145fb6a81c42 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:32.328871 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-29d2e9e8-32df-433a-8171-145fb6a81c42 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:32.329309 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-29d2e9e8-32df-433a-8171-145fb6a81c42 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:32.398122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-29d2e9e8-32df-433a-8171-145fb6a81c42 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:32.406030 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-29d2e9e8-32df-433a-8171-145fb6a81c42 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1329 microversion: 2.1 time: 0.090126 Jun 16 16:15:32.406619 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 204/411] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:32 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1329 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:32.677002 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-0d46dfd7-b5df-42fe-8594-1c65c8df7990 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:32.677614 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-0d46dfd7-b5df-42fe-8594-1c65c8df7990 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:32.680944 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=4 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:32.687026 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0d46dfd7-b5df-42fe-8594-1c65c8df7990 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:32.687475 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0d46dfd7-b5df-42fe-8594-1c65c8df7990 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:32.688258 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0d46dfd7-b5df-42fe-8594-1c65c8df7990 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:32.688691 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0d46dfd7-b5df-42fe-8594-1c65c8df7990 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:32.730091 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b06786a6-9b67-4762-931d-2054b464f5ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:32.730830 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b06786a6-9b67-4762-931d-2054b464f5ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:32.737573 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b06786a6-9b67-4762-931d-2054b464f5ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:32.738182 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b06786a6-9b67-4762-931d-2054b464f5ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:32.739102 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b06786a6-9b67-4762-931d-2054b464f5ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:32.739560 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b06786a6-9b67-4762-931d-2054b464f5ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:32.755393 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-0d46dfd7-b5df-42fe-8594-1c65c8df7990 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:32.765825 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-0d46dfd7-b5df-42fe-8594-1c65c8df7990 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1304 microversion: 2.1 time: 0.092552 Jun 16 16:15:32.766601 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 208/412] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:32 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:32.885669 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b06786a6-9b67-4762-931d-2054b464f5ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:32.890320 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=100 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:32.895774 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b06786a6-9b67-4762-931d-2054b464f5ac tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1722 microversion: 2.1 time: 0.170743 Jun 16 16:15:32.896497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 205/413] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:32 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:33.422480 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8206d658-92a0-46df-b36d-9fb8f1ab3a81 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:33.423117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8206d658-92a0-46df-b36d-9fb8f1ab3a81 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:33.429435 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8206d658-92a0-46df-b36d-9fb8f1ab3a81 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:33.429881 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8206d658-92a0-46df-b36d-9fb8f1ab3a81 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:33.430667 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8206d658-92a0-46df-b36d-9fb8f1ab3a81 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:33.431096 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8206d658-92a0-46df-b36d-9fb8f1ab3a81 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:33.502307 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8206d658-92a0-46df-b36d-9fb8f1ab3a81 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:33.511522 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8206d658-92a0-46df-b36d-9fb8f1ab3a81 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1329 microversion: 2.1 time: 0.092797 Jun 16 16:15:33.512107 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 209/414] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:33 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1329 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:33.784457 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-58d96e61-80a7-47b0-b106-7dfd201b666e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:33.802958 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-58d96e61-80a7-47b0-b106-7dfd201b666e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:33.818865 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=4 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:33.821950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=16 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:33.824389 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58d96e61-80a7-47b0-b106-7dfd201b666e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:33.825349 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58d96e61-80a7-47b0-b106-7dfd201b666e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:33.826466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58d96e61-80a7-47b0-b106-7dfd201b666e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:33.827216 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58d96e61-80a7-47b0-b106-7dfd201b666e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:33.918707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e1fbbd5d-d49f-447d-9236-5eb6d16e4d4d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:33.925855 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e1fbbd5d-d49f-447d-9236-5eb6d16e4d4d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:33.940548 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1fbbd5d-d49f-447d-9236-5eb6d16e4d4d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:33.942100 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1fbbd5d-d49f-447d-9236-5eb6d16e4d4d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:33.946323 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1fbbd5d-d49f-447d-9236-5eb6d16e4d4d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:33.947580 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1fbbd5d-d49f-447d-9236-5eb6d16e4d4d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:34.068676 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-58d96e61-80a7-47b0-b106-7dfd201b666e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:34.083171 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-58d96e61-80a7-47b0-b106-7dfd201b666e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1304 microversion: 2.1 time: 0.303489 Jun 16 16:15:34.094214 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 206/415] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:33 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1304 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:34.280967 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e1fbbd5d-d49f-447d-9236-5eb6d16e4d4d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:34.291199 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e1fbbd5d-d49f-447d-9236-5eb6d16e4d4d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1699 microversion: 2.1 time: 0.381191 Jun 16 16:15:34.291806 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 210/416] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:33 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1699 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:34.310317 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9cf0789d-8876-4f6d-8bbf-2132528d9827 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:34.318273 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9cf0789d-8876-4f6d-8bbf-2132528d9827 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:34.319222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9cf0789d-8876-4f6d-8bbf-2132528d9827 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:34.353013 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9cf0789d-8876-4f6d-8bbf-2132528d9827 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Going to try to start instance {{(pid=117755) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 16:15:34.425964 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9cf0789d-8876-4f6d-8bbf-2132528d9827 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "POST /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/action" status: 202 len: 0 microversion: 2.1 time: 0.118629 Jun 16 16:15:34.428779 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 207/417] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 16:15:34 2022] POST /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:15:34.440372 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-583ee47a-275a-4257-908c-f5f35a5ee505 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:34.441415 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-583ee47a-275a-4257-908c-f5f35a5ee505 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:34.455467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-583ee47a-275a-4257-908c-f5f35a5ee505 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:34.457202 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-583ee47a-275a-4257-908c-f5f35a5ee505 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:34.461162 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-583ee47a-275a-4257-908c-f5f35a5ee505 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:34.464272 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-583ee47a-275a-4257-908c-f5f35a5ee505 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:34.537961 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-42e8331e-1a9e-4eb7-930a-8fb459d9b0ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:34.544127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-42e8331e-1a9e-4eb7-930a-8fb459d9b0ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:34.566000 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42e8331e-1a9e-4eb7-930a-8fb459d9b0ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:34.566792 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42e8331e-1a9e-4eb7-930a-8fb459d9b0ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:34.568310 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42e8331e-1a9e-4eb7-930a-8fb459d9b0ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:34.571153 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42e8331e-1a9e-4eb7-930a-8fb459d9b0ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:34.728276 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-583ee47a-275a-4257-908c-f5f35a5ee505 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:34.739735 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-583ee47a-275a-4257-908c-f5f35a5ee505 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1708 microversion: 2.1 time: 0.304500 Jun 16 16:15:34.746374 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 211/418] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:34 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1708 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:35.108838 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c2ffc877-ff69-449b-ac19-420107fc90b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:35.109789 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c2ffc877-ff69-449b-ac19-420107fc90b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:35.129718 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c2ffc877-ff69-449b-ac19-420107fc90b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:35.130312 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c2ffc877-ff69-449b-ac19-420107fc90b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:35.131130 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c2ffc877-ff69-449b-ac19-420107fc90b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:35.146032 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c2ffc877-ff69-449b-ac19-420107fc90b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:35.219379 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-42e8331e-1a9e-4eb7-930a-8fb459d9b0ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:35.267739 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-42e8331e-1a9e-4eb7-930a-8fb459d9b0ee tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.733703 Jun 16 16:15:35.295196 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 208/419] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:34 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:35.651873 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c2ffc877-ff69-449b-ac19-420107fc90b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:35.665291 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c2ffc877-ff69-449b-ac19-420107fc90b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.560833 Jun 16 16:15:35.683376 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 212/420] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:35 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:35.782710 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-419339e7-bcf2-4f93-8869-de4d84520a8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:35.784566 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-419339e7-bcf2-4f93-8869-de4d84520a8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:35.846012 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-419339e7-bcf2-4f93-8869-de4d84520a8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:35.852616 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-419339e7-bcf2-4f93-8869-de4d84520a8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:35.854488 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-419339e7-bcf2-4f93-8869-de4d84520a8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:35.866548 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-419339e7-bcf2-4f93-8869-de4d84520a8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:36.188300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-419339e7-bcf2-4f93-8869-de4d84520a8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:36.201413 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-419339e7-bcf2-4f93-8869-de4d84520a8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1708 microversion: 2.1 time: 0.431058 Jun 16 16:15:36.214133 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 209/421] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:35 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1708 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:36.323756 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-61f94d0c-fa17-49c9-8965-da331ac848b8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:36.329250 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-61f94d0c-fa17-49c9-8965-da331ac848b8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:36.347387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61f94d0c-fa17-49c9-8965-da331ac848b8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:36.348412 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61f94d0c-fa17-49c9-8965-da331ac848b8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:36.351965 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61f94d0c-fa17-49c9-8965-da331ac848b8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:36.359905 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61f94d0c-fa17-49c9-8965-da331ac848b8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:36.695412 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9a13bf77-2ca3-413d-80b6-d9d58cdcac84 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:36.697663 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9a13bf77-2ca3-413d-80b6-d9d58cdcac84 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:36.706830 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9a13bf77-2ca3-413d-80b6-d9d58cdcac84 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:36.708019 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9a13bf77-2ca3-413d-80b6-d9d58cdcac84 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:36.709274 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9a13bf77-2ca3-413d-80b6-d9d58cdcac84 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:36.711028 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9a13bf77-2ca3-413d-80b6-d9d58cdcac84 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:36.806512 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-61f94d0c-fa17-49c9-8965-da331ac848b8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:36.825799 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-61f94d0c-fa17-49c9-8965-da331ac848b8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.519763 Jun 16 16:15:36.845003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 213/422] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:36 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:37.056512 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9a13bf77-2ca3-413d-80b6-d9d58cdcac84 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:37.079490 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9a13bf77-2ca3-413d-80b6-d9d58cdcac84 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.390225 Jun 16 16:15:37.081056 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 210/423] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:36 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:37.229384 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-09206707-a593-4fb5-9d27-97a380a45c62 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:37.233883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-09206707-a593-4fb5-9d27-97a380a45c62 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:37.267469 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-09206707-a593-4fb5-9d27-97a380a45c62 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:37.273334 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-09206707-a593-4fb5-9d27-97a380a45c62 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:37.279904 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-09206707-a593-4fb5-9d27-97a380a45c62 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:37.290754 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-09206707-a593-4fb5-9d27-97a380a45c62 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:37.778966 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-09206707-a593-4fb5-9d27-97a380a45c62 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:37.805749 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-09206707-a593-4fb5-9d27-97a380a45c62 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1708 microversion: 2.1 time: 0.583230 Jun 16 16:15:37.806685 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 214/424] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:37 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1708 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:37.856133 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-db5b758d-d7bf-47a8-a91d-9555ad6fbe94 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:37.858348 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-db5b758d-d7bf-47a8-a91d-9555ad6fbe94 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:37.892062 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db5b758d-d7bf-47a8-a91d-9555ad6fbe94 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:37.894112 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db5b758d-d7bf-47a8-a91d-9555ad6fbe94 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:37.896331 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db5b758d-d7bf-47a8-a91d-9555ad6fbe94 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:37.897692 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db5b758d-d7bf-47a8-a91d-9555ad6fbe94 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:38.159999 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a3bfe26c-bcea-4dca-989f-73718105fa9d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:38.161375 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a3bfe26c-bcea-4dca-989f-73718105fa9d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:38.222486 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a3bfe26c-bcea-4dca-989f-73718105fa9d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:38.234202 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a3bfe26c-bcea-4dca-989f-73718105fa9d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:38.239806 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a3bfe26c-bcea-4dca-989f-73718105fa9d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:38.243023 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a3bfe26c-bcea-4dca-989f-73718105fa9d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:38.634528 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-db5b758d-d7bf-47a8-a91d-9555ad6fbe94 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:38.651163 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-db5b758d-d7bf-47a8-a91d-9555ad6fbe94 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.802213 Jun 16 16:15:38.652788 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 211/425] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:37 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:38.847386 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-33680a7f-b8e1-4a35-a337-06bb848e2013 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:38.854592 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-33680a7f-b8e1-4a35-a337-06bb848e2013 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:38.932916 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-33680a7f-b8e1-4a35-a337-06bb848e2013 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:38.941844 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-33680a7f-b8e1-4a35-a337-06bb848e2013 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:38.947170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-33680a7f-b8e1-4a35-a337-06bb848e2013 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:38.970530 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-33680a7f-b8e1-4a35-a337-06bb848e2013 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:39.514983 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a3bfe26c-bcea-4dca-989f-73718105fa9d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:39.552667 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a3bfe26c-bcea-4dca-989f-73718105fa9d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 1.449180 Jun 16 16:15:39.553762 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 215/426] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:38 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:39.684803 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-064ef32e-2496-430d-8fc9-9db9298b56da tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:39.685430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-064ef32e-2496-430d-8fc9-9db9298b56da tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:39.728675 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-064ef32e-2496-430d-8fc9-9db9298b56da tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:39.729420 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-064ef32e-2496-430d-8fc9-9db9298b56da tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:39.730720 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-064ef32e-2496-430d-8fc9-9db9298b56da tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:39.731556 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-064ef32e-2496-430d-8fc9-9db9298b56da tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:40.202575 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-33680a7f-b8e1-4a35-a337-06bb848e2013 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:40.235844 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-33680a7f-b8e1-4a35-a337-06bb848e2013 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1708 microversion: 2.1 time: 1.400027 Jun 16 16:15:40.243002 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 212/427] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:38 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1708 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:40.454329 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-064ef32e-2496-430d-8fc9-9db9298b56da tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:40.474144 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-064ef32e-2496-430d-8fc9-9db9298b56da tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.797181 Jun 16 16:15:40.481062 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 216/428] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:39 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:40.587986 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f8074db7-5999-4c15-87e4-417a03472042 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:40.589023 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f8074db7-5999-4c15-87e4-417a03472042 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:40.614864 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f8074db7-5999-4c15-87e4-417a03472042 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:40.615638 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f8074db7-5999-4c15-87e4-417a03472042 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:40.622422 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f8074db7-5999-4c15-87e4-417a03472042 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:40.622933 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f8074db7-5999-4c15-87e4-417a03472042 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:41.041651 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f8074db7-5999-4c15-87e4-417a03472042 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:41.056639 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f8074db7-5999-4c15-87e4-417a03472042 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.477311 Jun 16 16:15:41.059255 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 213/429] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:40 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:41.200611 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-1a5d90e6-25c0-4b92-9899-f0851141885c req-08e0375d-2bd5-4476-86ad-580a76c7cbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822d94ad-db52-4de9-8dfe-e3317ec09961", "tag": "5082da5f-5306-4a23-b35d-d8a60373485c"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:41.226222 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-1a5d90e6-25c0-4b92-9899-f0851141885c req-08e0375d-2bd5-4476-86ad-580a76c7cbc7 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:41.227908 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-1a5d90e6-25c0-4b92-9899-f0851141885c req-08e0375d-2bd5-4476-86ad-580a76c7cbc7 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:41.268463 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-1a5d90e6-25c0-4b92-9899-f0851141885c req-08e0375d-2bd5-4476-86ad-580a76c7cbc7 service nova] Creating event network-changed:5082da5f-5306-4a23-b35d-d8a60373485c for instance 822d94ad-db52-4de9-8dfe-e3317ec09961 on hv-cinder-83716 Jun 16 16:15:41.269080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bd83d796-bd6e-4589-bdd3-133fc6f5ff5f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:41.269779 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bd83d796-bd6e-4589-bdd3-133fc6f5ff5f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:41.278179 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-1a5d90e6-25c0-4b92-9899-f0851141885c req-08e0375d-2bd5-4476-86ad-580a76c7cbc7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087116 Jun 16 16:15:41.285190 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bd83d796-bd6e-4589-bdd3-133fc6f5ff5f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:41.286279 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 217/430] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:41.290188 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bd83d796-bd6e-4589-bdd3-133fc6f5ff5f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:41.291887 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bd83d796-bd6e-4589-bdd3-133fc6f5ff5f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:41.292705 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bd83d796-bd6e-4589-bdd3-133fc6f5ff5f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:41.492619 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-3dd1f001-0f4a-4388-849d-9ebe472a768f req-17312f82-1914-46cb-8c3c-3a95b2003e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a915f676-f877-4b53-9061-2b6d5216e40f", "tag": "3a209b58-0eab-4734-8530-5197ed6024ff"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:41.524464 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-3dd1f001-0f4a-4388-849d-9ebe472a768f req-17312f82-1914-46cb-8c3c-3a95b2003e2c service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:41.528111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-3dd1f001-0f4a-4388-849d-9ebe472a768f req-17312f82-1914-46cb-8c3c-3a95b2003e2c service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:41.563683 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-3dd1f001-0f4a-4388-849d-9ebe472a768f req-17312f82-1914-46cb-8c3c-3a95b2003e2c service nova] Creating event network-changed:3a209b58-0eab-4734-8530-5197ed6024ff for instance a915f676-f877-4b53-9061-2b6d5216e40f on hv-cinder-83716 Jun 16 16:15:41.578719 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-3dd1f001-0f4a-4388-849d-9ebe472a768f req-17312f82-1914-46cb-8c3c-3a95b2003e2c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095343 Jun 16 16:15:41.589023 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 218/431] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:15:41.616285 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7245454b-c8de-409d-8c73-e844a3f446a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:41.619666 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7245454b-c8de-409d-8c73-e844a3f446a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:41.636133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7245454b-c8de-409d-8c73-e844a3f446a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:41.637309 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7245454b-c8de-409d-8c73-e844a3f446a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:41.638381 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7245454b-c8de-409d-8c73-e844a3f446a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:41.644637 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7245454b-c8de-409d-8c73-e844a3f446a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:41.706898 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=100 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:41.715227 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bd83d796-bd6e-4589-bdd3-133fc6f5ff5f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:41.742536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bd83d796-bd6e-4589-bdd3-133fc6f5ff5f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1708 microversion: 2.1 time: 0.477536 Jun 16 16:15:41.753153 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 214/432] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:41 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1708 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:42.040055 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7245454b-c8de-409d-8c73-e844a3f446a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:42.054585 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7245454b-c8de-409d-8c73-e844a3f446a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.448295 Jun 16 16:15:42.056609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 219/433] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:41 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:42.096628 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-74efc8a1-cef3-478e-89f2-2f7b163d0d88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:42.097822 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-74efc8a1-cef3-478e-89f2-2f7b163d0d88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:42.109530 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74efc8a1-cef3-478e-89f2-2f7b163d0d88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:42.110383 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74efc8a1-cef3-478e-89f2-2f7b163d0d88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:42.111376 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74efc8a1-cef3-478e-89f2-2f7b163d0d88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:42.112036 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74efc8a1-cef3-478e-89f2-2f7b163d0d88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:42.414552 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-74efc8a1-cef3-478e-89f2-2f7b163d0d88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:42.428569 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-74efc8a1-cef3-478e-89f2-2f7b163d0d88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.349639 Jun 16 16:15:42.439881 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 215/434] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:42 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:42.809470 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-afe4662e-6727-4026-9fcd-78b27fbc5d07 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:42.811820 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-afe4662e-6727-4026-9fcd-78b27fbc5d07 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:42.824137 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-afe4662e-6727-4026-9fcd-78b27fbc5d07 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:42.825452 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-afe4662e-6727-4026-9fcd-78b27fbc5d07 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:42.827388 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-afe4662e-6727-4026-9fcd-78b27fbc5d07 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:42.828562 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-afe4662e-6727-4026-9fcd-78b27fbc5d07 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:43.082015 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-39916203-6b90-45df-b549-5e2627f3e92d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:43.087325 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-39916203-6b90-45df-b549-5e2627f3e92d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:43.094016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:43.113296 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-39916203-6b90-45df-b549-5e2627f3e92d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:43.114115 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-39916203-6b90-45df-b549-5e2627f3e92d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:43.115376 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-39916203-6b90-45df-b549-5e2627f3e92d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:43.116101 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-39916203-6b90-45df-b549-5e2627f3e92d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:43.229572 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-afe4662e-6727-4026-9fcd-78b27fbc5d07 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:43.240450 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-afe4662e-6727-4026-9fcd-78b27fbc5d07 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1708 microversion: 2.1 time: 0.463653 Jun 16 16:15:43.243132 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 220/435] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:42 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1708 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:43.446960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-39916203-6b90-45df-b549-5e2627f3e92d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:43.450390 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b37db0ba-3afd-46f7-b91c-77f8e89beb88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:43.451565 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b37db0ba-3afd-46f7-b91c-77f8e89beb88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:43.461784 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-39916203-6b90-45df-b549-5e2627f3e92d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.388770 Jun 16 16:15:43.467446 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 216/436] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:43 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:43.478721 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b37db0ba-3afd-46f7-b91c-77f8e89beb88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:43.479790 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b37db0ba-3afd-46f7-b91c-77f8e89beb88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:43.480835 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b37db0ba-3afd-46f7-b91c-77f8e89beb88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:43.481484 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b37db0ba-3afd-46f7-b91c-77f8e89beb88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:43.883925 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b37db0ba-3afd-46f7-b91c-77f8e89beb88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:43.896333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b37db0ba-3afd-46f7-b91c-77f8e89beb88 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.452103 Jun 16 16:15:43.908423 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 221/437] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:43 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:44.284080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2535c7eb-5f75-4d00-b8c6-7876b785fd91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:44.285745 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2535c7eb-5f75-4d00-b8c6-7876b785fd91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:44.302054 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2535c7eb-5f75-4d00-b8c6-7876b785fd91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:44.302456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2535c7eb-5f75-4d00-b8c6-7876b785fd91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:44.307151 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2535c7eb-5f75-4d00-b8c6-7876b785fd91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:44.308645 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2535c7eb-5f75-4d00-b8c6-7876b785fd91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:44.489682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6dff64a1-4f3a-4322-ae46-622e20532119 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:44.491782 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6dff64a1-4f3a-4322-ae46-622e20532119 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:44.503795 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6dff64a1-4f3a-4322-ae46-622e20532119 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:44.504601 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6dff64a1-4f3a-4322-ae46-622e20532119 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:44.506084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6dff64a1-4f3a-4322-ae46-622e20532119 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:44.506989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6dff64a1-4f3a-4322-ae46-622e20532119 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:44.556740 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2535c7eb-5f75-4d00-b8c6-7876b785fd91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:44.576476 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2535c7eb-5f75-4d00-b8c6-7876b785fd91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1708 microversion: 2.1 time: 0.317398 Jun 16 16:15:44.589957 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 217/438] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:44 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1708 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:44.761012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6dff64a1-4f3a-4322-ae46-622e20532119 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:44.770653 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6dff64a1-4f3a-4322-ae46-622e20532119 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.288386 Jun 16 16:15:44.781720 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 222/439] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:44 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:44.923072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-63155bab-c96a-4ca2-9e9b-5cf31413de4f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:44.924708 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-63155bab-c96a-4ca2-9e9b-5cf31413de4f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:44.938671 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-63155bab-c96a-4ca2-9e9b-5cf31413de4f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:44.939422 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-63155bab-c96a-4ca2-9e9b-5cf31413de4f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:44.941078 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-63155bab-c96a-4ca2-9e9b-5cf31413de4f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:44.941849 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-63155bab-c96a-4ca2-9e9b-5cf31413de4f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:45.267057 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-63155bab-c96a-4ca2-9e9b-5cf31413de4f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:45.283567 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-63155bab-c96a-4ca2-9e9b-5cf31413de4f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.369152 Jun 16 16:15:45.284911 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 218/440] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:44 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:45.610507 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8f776f8f-02df-4dcb-b22f-0806ddeb7eee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:45.611550 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8f776f8f-02df-4dcb-b22f-0806ddeb7eee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:45.658685 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f776f8f-02df-4dcb-b22f-0806ddeb7eee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:45.659711 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f776f8f-02df-4dcb-b22f-0806ddeb7eee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:45.661065 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f776f8f-02df-4dcb-b22f-0806ddeb7eee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:45.661824 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f776f8f-02df-4dcb-b22f-0806ddeb7eee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:45.790668 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d8eac4af-e1b1-4fdf-873a-807e791cd7b6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:45.792577 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d8eac4af-e1b1-4fdf-873a-807e791cd7b6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:45.804381 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8eac4af-e1b1-4fdf-873a-807e791cd7b6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:45.807819 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8eac4af-e1b1-4fdf-873a-807e791cd7b6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:45.811377 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8eac4af-e1b1-4fdf-873a-807e791cd7b6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:45.812206 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d8eac4af-e1b1-4fdf-873a-807e791cd7b6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:46.220078 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8f776f8f-02df-4dcb-b22f-0806ddeb7eee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:46.242057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8f776f8f-02df-4dcb-b22f-0806ddeb7eee tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1708 microversion: 2.1 time: 0.638902 Jun 16 16:15:46.243661 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 223/441] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:45 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1708 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:46.260049 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d8eac4af-e1b1-4fdf-873a-807e791cd7b6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:46.279564 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d8eac4af-e1b1-4fdf-873a-807e791cd7b6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.493135 Jun 16 16:15:46.281374 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 219/442] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:45 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:46.314901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-87d7e967-ae5e-424a-90a3-e6ec3a59a83f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:46.315822 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-87d7e967-ae5e-424a-90a3-e6ec3a59a83f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:46.345905 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-87d7e967-ae5e-424a-90a3-e6ec3a59a83f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:46.346892 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-87d7e967-ae5e-424a-90a3-e6ec3a59a83f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:46.348218 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-87d7e967-ae5e-424a-90a3-e6ec3a59a83f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:46.348992 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-87d7e967-ae5e-424a-90a3-e6ec3a59a83f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:46.671065 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-87d7e967-ae5e-424a-90a3-e6ec3a59a83f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:46.694271 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-87d7e967-ae5e-424a-90a3-e6ec3a59a83f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.379709 Jun 16 16:15:46.708645 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 224/443] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:46 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:47.262948 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b9132e02-4137-4ba3-9fe2-9c4ba8a8bdeb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:47.264260 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b9132e02-4137-4ba3-9fe2-9c4ba8a8bdeb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:47.281801 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9132e02-4137-4ba3-9fe2-9c4ba8a8bdeb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:47.282541 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9132e02-4137-4ba3-9fe2-9c4ba8a8bdeb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:47.283525 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9132e02-4137-4ba3-9fe2-9c4ba8a8bdeb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:47.284212 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9132e02-4137-4ba3-9fe2-9c4ba8a8bdeb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:47.302378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6b16c5e2-1a4c-4814-885e-bc3380f5f8f6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:47.303488 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6b16c5e2-1a4c-4814-885e-bc3380f5f8f6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:47.321327 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6b16c5e2-1a4c-4814-885e-bc3380f5f8f6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:47.322265 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6b16c5e2-1a4c-4814-885e-bc3380f5f8f6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:47.323249 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6b16c5e2-1a4c-4814-885e-bc3380f5f8f6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:47.323857 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6b16c5e2-1a4c-4814-885e-bc3380f5f8f6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:47.656325 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b9132e02-4137-4ba3-9fe2-9c4ba8a8bdeb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:47.693108 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b9132e02-4137-4ba3-9fe2-9c4ba8a8bdeb tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1708 microversion: 2.1 time: 0.434009 Jun 16 16:15:47.715874 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 220/444] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:47 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1708 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:47.762360 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6b16c5e2-1a4c-4814-885e-bc3380f5f8f6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:47.781841 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-71084934-8479-44a0-9a15-53256676a0c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:47.782917 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-71084934-8479-44a0-9a15-53256676a0c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:47.797879 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6b16c5e2-1a4c-4814-885e-bc3380f5f8f6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.499359 Jun 16 16:15:47.815858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 225/445] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:47 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:47.836072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-71084934-8479-44a0-9a15-53256676a0c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:47.836917 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-71084934-8479-44a0-9a15-53256676a0c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:47.838323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-71084934-8479-44a0-9a15-53256676a0c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:47.839155 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-71084934-8479-44a0-9a15-53256676a0c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:47.899537 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:48.348718 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-71084934-8479-44a0-9a15-53256676a0c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:48.357772 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-71084934-8479-44a0-9a15-53256676a0c7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.638013 Jun 16 16:15:48.371575 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 221/446] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:47 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:48.720241 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-2c056e0f-4dde-47b2-b923-5738c5fa27f5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:48.721651 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2c056e0f-4dde-47b2-b923-5738c5fa27f5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:48.748568 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2c056e0f-4dde-47b2-b923-5738c5fa27f5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:48.751208 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2c056e0f-4dde-47b2-b923-5738c5fa27f5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:48.755165 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2c056e0f-4dde-47b2-b923-5738c5fa27f5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:48.758944 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2c056e0f-4dde-47b2-b923-5738c5fa27f5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:48.837618 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-513f43f3-2284-4834-8e9e-df8ef2ef5bf6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:48.839475 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-513f43f3-2284-4834-8e9e-df8ef2ef5bf6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:48.857075 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-513f43f3-2284-4834-8e9e-df8ef2ef5bf6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:48.863914 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-513f43f3-2284-4834-8e9e-df8ef2ef5bf6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:48.865415 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-513f43f3-2284-4834-8e9e-df8ef2ef5bf6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:48.866644 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-513f43f3-2284-4834-8e9e-df8ef2ef5bf6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:49.349913 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-2c056e0f-4dde-47b2-b923-5738c5fa27f5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:49.375414 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-2c056e0f-4dde-47b2-b923-5738c5fa27f5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1708 microversion: 2.1 time: 0.661983 Jun 16 16:15:49.379983 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 226/447] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:48 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1708 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:49.388070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-200cc591-df28-4f2e-bb4d-2e312d7bb5a8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:49.389579 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-200cc591-df28-4f2e-bb4d-2e312d7bb5a8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:49.408496 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-200cc591-df28-4f2e-bb4d-2e312d7bb5a8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:49.410671 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-200cc591-df28-4f2e-bb4d-2e312d7bb5a8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:49.413636 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-200cc591-df28-4f2e-bb4d-2e312d7bb5a8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:49.414827 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-200cc591-df28-4f2e-bb4d-2e312d7bb5a8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:50.079014 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-513f43f3-2284-4834-8e9e-df8ef2ef5bf6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:50.106622 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-513f43f3-2284-4834-8e9e-df8ef2ef5bf6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 1.274737 Jun 16 16:15:50.118984 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 222/448] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:48 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:50.403085 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d2fdeeb3-551a-4fad-b6fa-31bef59608a0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:50.403983 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d2fdeeb3-551a-4fad-b6fa-31bef59608a0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:50.419932 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d2fdeeb3-551a-4fad-b6fa-31bef59608a0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:50.422425 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d2fdeeb3-551a-4fad-b6fa-31bef59608a0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:50.429504 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d2fdeeb3-551a-4fad-b6fa-31bef59608a0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:50.430264 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d2fdeeb3-551a-4fad-b6fa-31bef59608a0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:50.439496 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-200cc591-df28-4f2e-bb4d-2e312d7bb5a8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:50.465733 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-200cc591-df28-4f2e-bb4d-2e312d7bb5a8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 1.073845 Jun 16 16:15:50.487295 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 227/449] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:49 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:51.141782 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b08f4f11-f96e-46c2-9950-4b770f0310c1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:51.143594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b08f4f11-f96e-46c2-9950-4b770f0310c1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:51.168825 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b08f4f11-f96e-46c2-9950-4b770f0310c1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:51.169458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b08f4f11-f96e-46c2-9950-4b770f0310c1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:51.170759 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b08f4f11-f96e-46c2-9950-4b770f0310c1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:51.184018 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b08f4f11-f96e-46c2-9950-4b770f0310c1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:51.472063 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d2fdeeb3-551a-4fad-b6fa-31bef59608a0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:51.478709 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b08f4f11-f96e-46c2-9950-4b770f0310c1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:51.490374 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b08f4f11-f96e-46c2-9950-4b770f0310c1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.357621 Jun 16 16:15:51.492880 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 228/450] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:51 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:51.498781 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-763a299a-35ff-4577-afbc-e32859ea702b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:51.499686 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d2fdeeb3-551a-4fad-b6fa-31bef59608a0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1708 microversion: 2.1 time: 1.103209 Jun 16 16:15:51.499981 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-763a299a-35ff-4577-afbc-e32859ea702b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:51.508630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-763a299a-35ff-4577-afbc-e32859ea702b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:51.509901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-763a299a-35ff-4577-afbc-e32859ea702b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:51.511487 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-763a299a-35ff-4577-afbc-e32859ea702b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:51.512774 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 223/451] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:50 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1708 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:51.513107 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-763a299a-35ff-4577-afbc-e32859ea702b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:51.814693 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-763a299a-35ff-4577-afbc-e32859ea702b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:51.854827 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-763a299a-35ff-4577-afbc-e32859ea702b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.344340 Jun 16 16:15:51.879217 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 229/452] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:51 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:52.511092 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-97325cb1-8ff0-4aa5-bcc6-a33f6ceb8521 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:52.512438 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-97325cb1-8ff0-4aa5-bcc6-a33f6ceb8521 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:52.531423 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-310501a4-b8b9-460d-9939-d9207be9f5d0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:52.532502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-310501a4-b8b9-460d-9939-d9207be9f5d0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:52.536652 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97325cb1-8ff0-4aa5-bcc6-a33f6ceb8521 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:52.537981 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97325cb1-8ff0-4aa5-bcc6-a33f6ceb8521 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:52.539021 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97325cb1-8ff0-4aa5-bcc6-a33f6ceb8521 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:52.539686 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-97325cb1-8ff0-4aa5-bcc6-a33f6ceb8521 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:52.575124 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-310501a4-b8b9-460d-9939-d9207be9f5d0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:52.576008 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-310501a4-b8b9-460d-9939-d9207be9f5d0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:52.580573 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-310501a4-b8b9-460d-9939-d9207be9f5d0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:52.581516 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-310501a4-b8b9-460d-9939-d9207be9f5d0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:52.954749 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-97325cb1-8ff0-4aa5-bcc6-a33f6ceb8521 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:52.978999 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-97325cb1-8ff0-4aa5-bcc6-a33f6ceb8521 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.472744 Jun 16 16:15:52.978999 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 224/453] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:52 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:52.978999 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c41d23f7-c945-4ce0-a2b4-7b03a458c30c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:53.010020 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c41d23f7-c945-4ce0-a2b4-7b03a458c30c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:53.036391 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c41d23f7-c945-4ce0-a2b4-7b03a458c30c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:53.038333 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c41d23f7-c945-4ce0-a2b4-7b03a458c30c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:53.039309 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c41d23f7-c945-4ce0-a2b4-7b03a458c30c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:53.040498 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c41d23f7-c945-4ce0-a2b4-7b03a458c30c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:53.041623 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-310501a4-b8b9-460d-9939-d9207be9f5d0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:53.052959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-310501a4-b8b9-460d-9939-d9207be9f5d0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1712 microversion: 2.1 time: 0.535199 Jun 16 16:15:53.054118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 230/454] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:52 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1712 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:53.347234 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c41d23f7-c945-4ce0-a2b4-7b03a458c30c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:53.363120 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c41d23f7-c945-4ce0-a2b4-7b03a458c30c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.373863 Jun 16 16:15:53.364544 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 225/455] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:52 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:54.004470 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c645902e-56b2-411b-a4c9-b3111905ce88 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:54.005805 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c645902e-56b2-411b-a4c9-b3111905ce88 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:54.026905 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c645902e-56b2-411b-a4c9-b3111905ce88 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:54.029406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c645902e-56b2-411b-a4c9-b3111905ce88 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:54.033411 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c645902e-56b2-411b-a4c9-b3111905ce88 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:54.039110 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c645902e-56b2-411b-a4c9-b3111905ce88 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:54.395780 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-48758b2b-e856-4556-9b85-beff1b220baf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:54.398093 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-48758b2b-e856-4556-9b85-beff1b220baf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:54.418128 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-48758b2b-e856-4556-9b85-beff1b220baf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:54.419964 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-48758b2b-e856-4556-9b85-beff1b220baf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:54.424293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-48758b2b-e856-4556-9b85-beff1b220baf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:54.429613 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-48758b2b-e856-4556-9b85-beff1b220baf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:54.714395 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c645902e-56b2-411b-a4c9-b3111905ce88 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:54.733614 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c645902e-56b2-411b-a4c9-b3111905ce88 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.734741 Jun 16 16:15:54.736272 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 231/456] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:53 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:54.859254 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-48758b2b-e856-4556-9b85-beff1b220baf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:54.877099 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-48758b2b-e856-4556-9b85-beff1b220baf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.488347 Jun 16 16:15:54.889224 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 226/457] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:54 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:55.768402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-abd8f51a-1aab-42e6-b382-05fa1216372d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:55.774572 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-abd8f51a-1aab-42e6-b382-05fa1216372d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:55.778804 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=66 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:55.790263 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-abd8f51a-1aab-42e6-b382-05fa1216372d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:55.791509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-abd8f51a-1aab-42e6-b382-05fa1216372d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:55.794239 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-abd8f51a-1aab-42e6-b382-05fa1216372d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:55.795532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-abd8f51a-1aab-42e6-b382-05fa1216372d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:55.904947 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-cee87dcf-6cfa-4d4d-b1b5-7196d71fb047 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:55.907926 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-cee87dcf-6cfa-4d4d-b1b5-7196d71fb047 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:55.935653 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cee87dcf-6cfa-4d4d-b1b5-7196d71fb047 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:55.937209 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cee87dcf-6cfa-4d4d-b1b5-7196d71fb047 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:55.939627 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cee87dcf-6cfa-4d4d-b1b5-7196d71fb047 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:55.941636 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cee87dcf-6cfa-4d4d-b1b5-7196d71fb047 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:56.079329 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-abd8f51a-1aab-42e6-b382-05fa1216372d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:56.094814 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-abd8f51a-1aab-42e6-b382-05fa1216372d tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.333932 Jun 16 16:15:56.096027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 232/458] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:55 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:56.194361 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cee87dcf-6cfa-4d4d-b1b5-7196d71fb047 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:56.208905 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-cee87dcf-6cfa-4d4d-b1b5-7196d71fb047 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.312587 Jun 16 16:15:56.210565 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 227/459] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:55 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:57.120988 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-18696d84-aa03-46c6-8e9e-efbb32a61794 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:57.123674 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-18696d84-aa03-46c6-8e9e-efbb32a61794 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:57.152497 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-18696d84-aa03-46c6-8e9e-efbb32a61794 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:57.155855 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-18696d84-aa03-46c6-8e9e-efbb32a61794 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:57.159282 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-18696d84-aa03-46c6-8e9e-efbb32a61794 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:57.161105 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-18696d84-aa03-46c6-8e9e-efbb32a61794 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:57.235311 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-81779104-0636-4702-af8a-385d60a26c97 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:57.240801 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-81779104-0636-4702-af8a-385d60a26c97 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:57.260143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-81779104-0636-4702-af8a-385d60a26c97 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:57.260488 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-81779104-0636-4702-af8a-385d60a26c97 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:57.261370 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-81779104-0636-4702-af8a-385d60a26c97 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:57.262042 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-81779104-0636-4702-af8a-385d60a26c97 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:57.495857 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-18696d84-aa03-46c6-8e9e-efbb32a61794 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:57.514306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-18696d84-aa03-46c6-8e9e-efbb32a61794 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.401164 Jun 16 16:15:57.525117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 233/460] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:57 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:57.635801 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-81779104-0636-4702-af8a-385d60a26c97 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:57.669977 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-81779104-0636-4702-af8a-385d60a26c97 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.439360 Jun 16 16:15:57.671437 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 228/461] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:57 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:58.538222 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-0928027e-dfb9-411c-8e21-b065ca1b4734 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:58.540494 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-0928027e-dfb9-411c-8e21-b065ca1b4734 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:58.552543 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0928027e-dfb9-411c-8e21-b065ca1b4734 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:58.554599 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0928027e-dfb9-411c-8e21-b065ca1b4734 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:58.556316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0928027e-dfb9-411c-8e21-b065ca1b4734 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:58.557567 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0928027e-dfb9-411c-8e21-b065ca1b4734 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:58.699680 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a05d4f1f-447a-456f-9e90-e1c23197b3cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:58.701236 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a05d4f1f-447a-456f-9e90-e1c23197b3cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:58.715174 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a05d4f1f-447a-456f-9e90-e1c23197b3cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:58.716974 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a05d4f1f-447a-456f-9e90-e1c23197b3cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:58.718911 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a05d4f1f-447a-456f-9e90-e1c23197b3cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:58.720065 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a05d4f1f-447a-456f-9e90-e1c23197b3cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:58.911805 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-0928027e-dfb9-411c-8e21-b065ca1b4734 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:58.933973 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-0928027e-dfb9-411c-8e21-b065ca1b4734 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.404468 Jun 16 16:15:58.936272 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 234/462] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:58 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:59.076292 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a05d4f1f-447a-456f-9e90-e1c23197b3cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:59.089845 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a05d4f1f-447a-456f-9e90-e1c23197b3cc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.397684 Jun 16 16:15:59.091645 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 229/463] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:58 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:59.761408 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-646c1b30-0533-47a2-a3e3-8126ca4d99f6 req-25f2c43d-c9f5-4612-8ae2-b4b915943f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822d94ad-db52-4de9-8dfe-e3317ec09961", "name": "network-vif-plugged", "status": "completed", "tag": "5082da5f-5306-4a23-b35d-d8a60373485c"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:59.800562 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-646c1b30-0533-47a2-a3e3-8126ca4d99f6 req-25f2c43d-c9f5-4612-8ae2-b4b915943f76 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:59.803702 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-646c1b30-0533-47a2-a3e3-8126ca4d99f6 req-25f2c43d-c9f5-4612-8ae2-b4b915943f76 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:59.854203 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-646c1b30-0533-47a2-a3e3-8126ca4d99f6 req-25f2c43d-c9f5-4612-8ae2-b4b915943f76 service nova] Creating event network-vif-plugged:5082da5f-5306-4a23-b35d-d8a60373485c for instance 822d94ad-db52-4de9-8dfe-e3317ec09961 on hv-cinder-83716 Jun 16 16:15:59.874896 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-646c1b30-0533-47a2-a3e3-8126ca4d99f6 req-25f2c43d-c9f5-4612-8ae2-b4b915943f76 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119952 Jun 16 16:15:59.877801 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 235/464] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:59.961821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b7a8b99c-ebaf-4563-b86d-8121f6a9ab0a tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:59.962763 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b7a8b99c-ebaf-4563-b86d-8121f6a9ab0a tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:59.979547 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b7a8b99c-ebaf-4563-b86d-8121f6a9ab0a tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:59.979890 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b7a8b99c-ebaf-4563-b86d-8121f6a9ab0a tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:59.982016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b7a8b99c-ebaf-4563-b86d-8121f6a9ab0a tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:59.982876 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b7a8b99c-ebaf-4563-b86d-8121f6a9ab0a tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:00.116452 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3b174590-1888-4014-9615-f0e202072a90 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:00.118623 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3b174590-1888-4014-9615-f0e202072a90 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:00.138642 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3b174590-1888-4014-9615-f0e202072a90 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:00.144334 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3b174590-1888-4014-9615-f0e202072a90 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:00.159099 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3b174590-1888-4014-9615-f0e202072a90 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:00.160325 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3b174590-1888-4014-9615-f0e202072a90 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:00.283108 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b7a8b99c-ebaf-4563-b86d-8121f6a9ab0a tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:00.293325 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b7a8b99c-ebaf-4563-b86d-8121f6a9ab0a tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.338436 Jun 16 16:16:00.304300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 230/465] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:59 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:00.709350 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3b174590-1888-4014-9615-f0e202072a90 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:00.728634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=100 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:00.734977 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3b174590-1888-4014-9615-f0e202072a90 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.623837 Jun 16 16:16:00.738449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 236/466] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:00 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:01.317152 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-43a0edcf-df89-470f-8359-bc0e9bbab0a4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:01.321419 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-43a0edcf-df89-470f-8359-bc0e9bbab0a4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:01.337517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43a0edcf-df89-470f-8359-bc0e9bbab0a4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:01.338897 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43a0edcf-df89-470f-8359-bc0e9bbab0a4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:01.341167 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43a0edcf-df89-470f-8359-bc0e9bbab0a4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:01.342109 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43a0edcf-df89-470f-8359-bc0e9bbab0a4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:01.562965 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-43a0edcf-df89-470f-8359-bc0e9bbab0a4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:01.580956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-43a0edcf-df89-470f-8359-bc0e9bbab0a4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.270270 Jun 16 16:16:01.586648 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 231/467] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:01 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:01.782218 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-13151cf5-fd24-43de-87b4-713cf85e5f07 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:01.782218 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-13151cf5-fd24-43de-87b4-713cf85e5f07 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:01.796691 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-13151cf5-fd24-43de-87b4-713cf85e5f07 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:01.798061 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-13151cf5-fd24-43de-87b4-713cf85e5f07 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:01.799916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-13151cf5-fd24-43de-87b4-713cf85e5f07 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:01.801317 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-13151cf5-fd24-43de-87b4-713cf85e5f07 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:02.020670 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-13151cf5-fd24-43de-87b4-713cf85e5f07 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:02.043364 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-13151cf5-fd24-43de-87b4-713cf85e5f07 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.273997 Jun 16 16:16:02.046535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 237/468] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:01 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:02.612445 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ce061c4d-b485-496d-8387-85d79b49d7af tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:02.616364 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ce061c4d-b485-496d-8387-85d79b49d7af tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:02.639068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce061c4d-b485-496d-8387-85d79b49d7af tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:02.640629 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce061c4d-b485-496d-8387-85d79b49d7af tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:02.642741 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce061c4d-b485-496d-8387-85d79b49d7af tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:02.644273 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce061c4d-b485-496d-8387-85d79b49d7af tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:02.888964 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ce061c4d-b485-496d-8387-85d79b49d7af tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:02.901591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ce061c4d-b485-496d-8387-85d79b49d7af tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1359 microversion: 2.1 time: 0.294986 Jun 16 16:16:02.902901 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 232/469] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:02 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1359 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:03.072675 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f80f4c62-f4b4-49cf-bb9b-e320b49d4ecd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:03.074213 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f80f4c62-f4b4-49cf-bb9b-e320b49d4ecd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:03.082736 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f80f4c62-f4b4-49cf-bb9b-e320b49d4ecd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:03.083221 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f80f4c62-f4b4-49cf-bb9b-e320b49d4ecd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:03.085221 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f80f4c62-f4b4-49cf-bb9b-e320b49d4ecd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:03.086051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f80f4c62-f4b4-49cf-bb9b-e320b49d4ecd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:03.261952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f80f4c62-f4b4-49cf-bb9b-e320b49d4ecd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:03.276532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f80f4c62-f4b4-49cf-bb9b-e320b49d4ecd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.210174 Jun 16 16:16:03.277636 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 238/470] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:03 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:03.922755 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-68c24301-1881-43c5-94de-da6582d3f62e req-17cdb78c-be7b-4781-ba1e-6f7185bc286c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a915f676-f877-4b53-9061-2b6d5216e40f", "name": "network-vif-plugged", "status": "completed", "tag": "3a209b58-0eab-4734-8530-5197ed6024ff"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:03.929690 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8b14d1a0-ceaf-4403-a609-50e750ece279 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:03.930476 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8b14d1a0-ceaf-4403-a609-50e750ece279 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:03.936816 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-68c24301-1881-43c5-94de-da6582d3f62e req-17cdb78c-be7b-4781-ba1e-6f7185bc286c service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:03.937711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-68c24301-1881-43c5-94de-da6582d3f62e req-17cdb78c-be7b-4781-ba1e-6f7185bc286c service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:03.939524 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8b14d1a0-ceaf-4403-a609-50e750ece279 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:03.940116 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8b14d1a0-ceaf-4403-a609-50e750ece279 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:03.941119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8b14d1a0-ceaf-4403-a609-50e750ece279 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:03.941817 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8b14d1a0-ceaf-4403-a609-50e750ece279 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:03.953595 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-68c24301-1881-43c5-94de-da6582d3f62e req-17cdb78c-be7b-4781-ba1e-6f7185bc286c service nova] Creating event network-vif-plugged:3a209b58-0eab-4734-8530-5197ed6024ff for instance a915f676-f877-4b53-9061-2b6d5216e40f on hv-cinder-83716 Jun 16 16:16:03.959630 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-68c24301-1881-43c5-94de-da6582d3f62e req-17cdb78c-be7b-4781-ba1e-6f7185bc286c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043631 Jun 16 16:16:03.960537 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 233/471] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:04.139708 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8b14d1a0-ceaf-4403-a609-50e750ece279 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:04.149396 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8b14d1a0-ceaf-4403-a609-50e750ece279 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1549 microversion: 2.1 time: 0.227870 Jun 16 16:16:04.150120 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 239/472] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:03 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1549 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:04.173078 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-239f0cec-0d30-470e-b683-0624ab1610cd tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:04.174479 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-239f0cec-0d30-470e-b683-0624ab1610cd tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:04.186101 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-239f0cec-0d30-470e-b683-0624ab1610cd tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:04.187115 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-239f0cec-0d30-470e-b683-0624ab1610cd tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:04.188325 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-239f0cec-0d30-470e-b683-0624ab1610cd tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:04.189289 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-239f0cec-0d30-470e-b683-0624ab1610cd tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:04.299831 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8f2247b4-48ef-48c9-b1d1-a3a42f5625ad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:04.301165 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8f2247b4-48ef-48c9-b1d1-a3a42f5625ad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:04.315927 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f2247b4-48ef-48c9-b1d1-a3a42f5625ad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:04.315927 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f2247b4-48ef-48c9-b1d1-a3a42f5625ad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:04.317212 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f2247b4-48ef-48c9-b1d1-a3a42f5625ad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:04.317974 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f2247b4-48ef-48c9-b1d1-a3a42f5625ad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:04.398954 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-239f0cec-0d30-470e-b683-0624ab1610cd tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:04.407554 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-239f0cec-0d30-470e-b683-0624ab1610cd tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1549 microversion: 2.1 time: 0.242555 Jun 16 16:16:04.408124 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 234/473] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:04 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1549 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:04.425365 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4ee2f054-88a6-4840-8329-5340f4823a61 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:04.428348 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4ee2f054-88a6-4840-8329-5340f4823a61 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:04.429200 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4ee2f054-88a6-4840-8329-5340f4823a61 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Searching by: {'deleted': False, 'project_id': '925cc45674694931bfe8fc60765045c2'} {{(pid=117755) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 16:16:04.438869 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4ee2f054-88a6-4840-8329-5340f4823a61 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:04.439627 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4ee2f054-88a6-4840-8329-5340f4823a61 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:04.441041 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4ee2f054-88a6-4840-8329-5340f4823a61 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:04.441838 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4ee2f054-88a6-4840-8329-5340f4823a61 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:04.515223 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8f2247b4-48ef-48c9-b1d1-a3a42f5625ad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:04.524228 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8f2247b4-48ef-48c9-b1d1-a3a42f5625ad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.231011 Jun 16 16:16:04.524808 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 240/474] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:04 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:04.575829 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.multi_cell_list [None req-4ee2f054-88a6-4840-8329-5340f4823a61 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117755) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 16:16:04.688266 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4ee2f054-88a6-4840-8329-5340f4823a61 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.267286 Jun 16 16:16:04.693386 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 235/475] 10.222.0.17 () {58 vars in 1124 bytes} [Thu Jun 16 16:16:04 2022] GET /compute/v2.1/servers => generated 343 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:16:04.701185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-9dd804d7-2e5c-4d80-b990-372733044cc9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:04.701844 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-9dd804d7-2e5c-4d80-b990-372733044cc9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:04.708699 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9dd804d7-2e5c-4d80-b990-372733044cc9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:04.709777 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9dd804d7-2e5c-4d80-b990-372733044cc9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:04.710590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9dd804d7-2e5c-4d80-b990-372733044cc9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:04.711021 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9dd804d7-2e5c-4d80-b990-372733044cc9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:04.916938 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-9dd804d7-2e5c-4d80-b990-372733044cc9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:04.933283 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-9dd804d7-2e5c-4d80-b990-372733044cc9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1549 microversion: 2.1 time: 0.235480 Jun 16 16:16:04.934260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 241/476] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:04 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1549 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:05.546725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-271f02b6-3f18-4671-a801-6a08b4d5ab4d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:05.547833 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-271f02b6-3f18-4671-a801-6a08b4d5ab4d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:05.556669 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-271f02b6-3f18-4671-a801-6a08b4d5ab4d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:05.557630 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-271f02b6-3f18-4671-a801-6a08b4d5ab4d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:05.558982 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-271f02b6-3f18-4671-a801-6a08b4d5ab4d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:05.559666 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-271f02b6-3f18-4671-a801-6a08b4d5ab4d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:05.760199 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-271f02b6-3f18-4671-a801-6a08b4d5ab4d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:05.771664 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-271f02b6-3f18-4671-a801-6a08b4d5ab4d tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1372 microversion: 2.1 time: 0.230706 Jun 16 16:16:05.772918 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 236/477] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:05 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1372 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:06.750631 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-5bcb69d3-64eb-466a-8624-a6bd78dd7c3b tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0abaa64-5750-484a-b80d-05af11e3add7"}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:06.752555 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-5bcb69d3-64eb-466a-8624-a6bd78dd7c3b tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:06.764014 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5bcb69d3-64eb-466a-8624-a6bd78dd7c3b tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:06.764722 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5bcb69d3-64eb-466a-8624-a6bd78dd7c3b tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:06.766131 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5bcb69d3-64eb-466a-8624-a6bd78dd7c3b tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:06.766903 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5bcb69d3-64eb-466a-8624-a6bd78dd7c3b tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:06.797230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-45f18f90-f2ce-49cb-8791-49e5338a9c1c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:06.798263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-45f18f90-f2ce-49cb-8791-49e5338a9c1c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:06.807130 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45f18f90-f2ce-49cb-8791-49e5338a9c1c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:06.807766 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45f18f90-f2ce-49cb-8791-49e5338a9c1c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:06.808716 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45f18f90-f2ce-49cb-8791-49e5338a9c1c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:06.809399 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-45f18f90-f2ce-49cb-8791-49e5338a9c1c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:07.008913 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-45f18f90-f2ce-49cb-8791-49e5338a9c1c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:07.021814 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-45f18f90-f2ce-49cb-8791-49e5338a9c1c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1566 microversion: 2.1 time: 0.229449 Jun 16 16:16:07.022727 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 237/478] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:06 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1566 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:07.046864 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-639775f5-6a3a-425b-813d-e45dad68086f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:07.047617 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-639775f5-6a3a-425b-813d-e45dad68086f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:07.054571 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-639775f5-6a3a-425b-813d-e45dad68086f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:07.055278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-639775f5-6a3a-425b-813d-e45dad68086f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:07.056142 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-639775f5-6a3a-425b-813d-e45dad68086f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:07.056577 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-639775f5-6a3a-425b-813d-e45dad68086f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:07.078341 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=100 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:07.166152 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-639775f5-6a3a-425b-813d-e45dad68086f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122690 Jun 16 16:16:07.177288 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 238/479] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 16:16:07 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:16:07.179172 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-5bcb69d3-64eb-466a-8624-a6bd78dd7c3b tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "POST /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428876 Jun 16 16:16:07.179172 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 242/480] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 16:16:06 2022] POST /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments => generated 194 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:08.788654 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-07f48c95-99b6-47ad-94fc-87b16c0428fd req-9f285115-956c-4162-a1d1-bc4b2d2555b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a915f676-f877-4b53-9061-2b6d5216e40f", "tag": "3a209b58-0eab-4734-8530-5197ed6024ff"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:08.807003 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-07f48c95-99b6-47ad-94fc-87b16c0428fd req-9f285115-956c-4162-a1d1-bc4b2d2555b3 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:08.807809 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-07f48c95-99b6-47ad-94fc-87b16c0428fd req-9f285115-956c-4162-a1d1-bc4b2d2555b3 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:08.829622 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-07f48c95-99b6-47ad-94fc-87b16c0428fd req-9f285115-956c-4162-a1d1-bc4b2d2555b3 service nova] Creating event network-changed:3a209b58-0eab-4734-8530-5197ed6024ff for instance a915f676-f877-4b53-9061-2b6d5216e40f on hv-cinder-83716 Jun 16 16:16:08.840891 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-07f48c95-99b6-47ad-94fc-87b16c0428fd req-9f285115-956c-4162-a1d1-bc4b2d2555b3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059197 Jun 16 16:16:08.842316 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 239/481] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:15.131442 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a97cd838-c9eb-404d-8857-b35dd8f4dcf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:15.132955 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a97cd838-c9eb-404d-8857-b35dd8f4dcf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:15.144213 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a97cd838-c9eb-404d-8857-b35dd8f4dcf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:15.144975 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a97cd838-c9eb-404d-8857-b35dd8f4dcf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:15.146465 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a97cd838-c9eb-404d-8857-b35dd8f4dcf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:15.147097 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a97cd838-c9eb-404d-8857-b35dd8f4dcf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:15.336585 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a97cd838-c9eb-404d-8857-b35dd8f4dcf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:15.351963 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a97cd838-c9eb-404d-8857-b35dd8f4dcf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1595 microversion: 2.1 time: 0.229976 Jun 16 16:16:15.352576 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 243/482] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:15 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1595 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:18.079178 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-e4d4b483-0259-41c9-be36-dec373f9db98 req-93401f29-b1cb-4ea2-a2da-d1d070d37505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822d94ad-db52-4de9-8dfe-e3317ec09961", "tag": "5082da5f-5306-4a23-b35d-d8a60373485c"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:18.088274 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=2 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:18.090631 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=47 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:18.104211 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-e4d4b483-0259-41c9-be36-dec373f9db98 req-93401f29-b1cb-4ea2-a2da-d1d070d37505 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:18.105052 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-e4d4b483-0259-41c9-be36-dec373f9db98 req-93401f29-b1cb-4ea2-a2da-d1d070d37505 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:18.119240 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-e4d4b483-0259-41c9-be36-dec373f9db98 req-93401f29-b1cb-4ea2-a2da-d1d070d37505 service nova] Creating event network-changed:5082da5f-5306-4a23-b35d-d8a60373485c for instance 822d94ad-db52-4de9-8dfe-e3317ec09961 on hv-cinder-83716 Jun 16 16:16:18.126051 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-e4d4b483-0259-41c9-be36-dec373f9db98 req-93401f29-b1cb-4ea2-a2da-d1d070d37505 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055962 Jun 16 16:16:18.127572 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 240/483] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:20.032762 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-724ba759-9dc1-4b19-b108-dd6418b019b0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-639997603"}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:20.033734 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-724ba759-9dc1-4b19-b108-dd6418b019b0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:20.043167 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-724ba759-9dc1-4b19-b108-dd6418b019b0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:20.044168 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-724ba759-9dc1-4b19-b108-dd6418b019b0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:20.044989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-724ba759-9dc1-4b19-b108-dd6418b019b0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:20.045434 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-724ba759-9dc1-4b19-b108-dd6418b019b0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:20.224835 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.network.security_group_api [None req-724ba759-9dc1-4b19-b108-dd6418b019b0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Adding security group 14275c86-d82b-4e27-a8bf-f2c4b95be5fe to port 5082da5f-5306-4a23-b35d-d8a60373485c Jun 16 16:16:20.660902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-724ba759-9dc1-4b19-b108-dd6418b019b0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "POST /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/action" status: 202 len: 0 microversion: 2.1 time: 0.634498 Jun 16 16:16:20.665080 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 244/484] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 16:16:20 2022] POST /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:16:20.676619 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5e5cd213-c9d6-41d0-a343-0c3ba29ab83f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:20.678102 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5e5cd213-c9d6-41d0-a343-0c3ba29ab83f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:20.686402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-0ede391e-e9c8-4541-9bd8-269bb586b0ff req-3c4c455d-0889-4f22-a3a5-8e2b437437b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822d94ad-db52-4de9-8dfe-e3317ec09961", "tag": "5082da5f-5306-4a23-b35d-d8a60373485c"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:20.702493 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e5cd213-c9d6-41d0-a343-0c3ba29ab83f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:20.703134 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e5cd213-c9d6-41d0-a343-0c3ba29ab83f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:20.704683 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e5cd213-c9d6-41d0-a343-0c3ba29ab83f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:20.705435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5e5cd213-c9d6-41d0-a343-0c3ba29ab83f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:20.713516 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-0ede391e-e9c8-4541-9bd8-269bb586b0ff req-3c4c455d-0889-4f22-a3a5-8e2b437437b3 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:20.713516 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-0ede391e-e9c8-4541-9bd8-269bb586b0ff req-3c4c455d-0889-4f22-a3a5-8e2b437437b3 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:20.746256 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-0ede391e-e9c8-4541-9bd8-269bb586b0ff req-3c4c455d-0889-4f22-a3a5-8e2b437437b3 service nova] Creating event network-changed:5082da5f-5306-4a23-b35d-d8a60373485c for instance 822d94ad-db52-4de9-8dfe-e3317ec09961 on hv-cinder-83716 Jun 16 16:16:20.762789 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-0ede391e-e9c8-4541-9bd8-269bb586b0ff req-3c4c455d-0889-4f22-a3a5-8e2b437437b3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086572 Jun 16 16:16:20.763739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 245/485] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:21.064160 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5e5cd213-c9d6-41d0-a343-0c3ba29ab83f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:21.085992 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5e5cd213-c9d6-41d0-a343-0c3ba29ab83f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1760 microversion: 2.1 time: 0.415443 Jun 16 16:16:21.087069 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 241/486] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:20 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1760 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:32.079940 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=27 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:32.080820 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:32.088048 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-77b4bf05-4d35-4738-b568-4387e07f71bd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:32.088708 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-77b4bf05-4d35-4738-b568-4387e07f71bd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:32.098297 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77b4bf05-4d35-4738-b568-4387e07f71bd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:32.098863 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77b4bf05-4d35-4738-b568-4387e07f71bd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:32.100448 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77b4bf05-4d35-4738-b568-4387e07f71bd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:32.100896 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77b4bf05-4d35-4738-b568-4387e07f71bd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:32.142024 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-77b4bf05-4d35-4738-b568-4387e07f71bd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85/ips" status: 200 len: 149 microversion: 2.1 time: 0.063471 Jun 16 16:16:32.142766 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 246/487] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 16:16:32 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85/ips => generated 149 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:32.159554 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7f4a757a-b004-4bdc-9f7b-c20591bf21c3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f368a239-bfb0-4b6e-93d7-47344909eb3a"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:32.161582 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7f4a757a-b004-4bdc-9f7b-c20591bf21c3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:32.164147 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=3 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:32.164969 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=10 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:32.172378 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7f4a757a-b004-4bdc-9f7b-c20591bf21c3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:32.172869 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7f4a757a-b004-4bdc-9f7b-c20591bf21c3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:32.173757 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7f4a757a-b004-4bdc-9f7b-c20591bf21c3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:32.174329 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7f4a757a-b004-4bdc-9f7b-c20591bf21c3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:32.278217 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-7f4a757a-b004-4bdc-9f7b-c20591bf21c3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] HTTP exception thrown: Invalid volume: volume f368a239-bfb0-4b6e-93d7-47344909eb3a is already attached to instances: e263395e-8f5e-4b76-85de-41bf42f947ae Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7f4a757a-b004-4bdc-9f7b-c20591bf21c3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Request method failure captured: Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: POST /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85/os-volume_attachments HTTP/1.1 Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 74 Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ZUq1kgzW_sDLNXIMMrLIuaVIQDyIYyD_QFPpTquNy4hAl_e3YmJtCQ9vDG5Gi9dl3M7alwHb45g-Cko2VZfCdciDPJaW1quIm5ySkHotQHkgN6wNvH9ZeEMkPp9RFHfNBz6m-xTNRiXVTSKnJGaGWLNz7_WuUCsTsM3KjkFbV_vCQ Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:16:32.280176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:16:32.282677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}] Jun 16 16:16:32.282677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:16:32.282677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:16:32.282677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:16:32.282677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:16:32.282677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:16:32.282677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:16:32.282677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 2c34f05634d34da29088bcf75069958d Jun 16 16:16:32.282677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:16:32.282677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Jun 16 16:16:32.282677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {"volumeAttachment": {"volumeId": "f368a239-bfb0-4b6e-93d7-47344909eb3a"}} Jun 16 16:16:32.282677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Invalid volume: volume f368a239-bfb0-4b6e-93d7-47344909eb3a is already attached to instances: e263395e-8f5e-4b76-85de-41bf42f947ae Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'server_id': '65f1126e-5b19-4b56-aa87-c4be0b53eb85', 'body': {'volumeAttachment': {'volumeId': 'f368a239-bfb0-4b6e-93d7-47344909eb3a'}}} Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f368a239-bfb0-4b6e-93d7-47344909eb3a is already attached to instances: e263395e-8f5e-4b76-85de-41bf42f947ae Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:16:32.283467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f368a239-bfb0-4b6e-93d7-47344909eb3a is already attached to instances: e263395e-8f5e-4b76-85de-41bf42f947ae Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:16:32.284783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:16:32.286244 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:16:32.286244 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:16:32.286244 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:16:32.286244 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f368a239-bfb0-4b6e-93d7-47344909eb3a is already attached to instances: e263395e-8f5e-4b76-85de-41bf42f947ae Jun 16 16:16:32.286244 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:16:32.286244 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7f4a757a-b004-4bdc-9f7b-c20591bf21c3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Returning 400 to user: Invalid volume: volume f368a239-bfb0-4b6e-93d7-47344909eb3a is already attached to instances: e263395e-8f5e-4b76-85de-41bf42f947ae {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:16:32.286244 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7f4a757a-b004-4bdc-9f7b-c20591bf21c3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "POST /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127182 Jun 16 16:16:32.286244 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 242/488] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 16:16:32 2022] POST /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85/os-volume_attachments => generated 174 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 16:16:32.292385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-2d1bf134-0d6e-40c7-91ab-2ea72f7fc8d6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:32.292881 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2d1bf134-0d6e-40c7-91ab-2ea72f7fc8d6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:32.299607 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2d1bf134-0d6e-40c7-91ab-2ea72f7fc8d6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:32.300049 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2d1bf134-0d6e-40c7-91ab-2ea72f7fc8d6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:32.300824 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2d1bf134-0d6e-40c7-91ab-2ea72f7fc8d6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:32.301257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2d1bf134-0d6e-40c7-91ab-2ea72f7fc8d6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:32.332267 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2d1bf134-0d6e-40c7-91ab-2ea72f7fc8d6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Going to try to terminate instance {{(pid=117756) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:16:32.427415 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-2d1bf134-0d6e-40c7-91ab-2ea72f7fc8d6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "DELETE /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 204 len: 0 microversion: 2.1 time: 0.137664 Jun 16 16:16:32.428451 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 247/489] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:16:32 2022] DELETE /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:16:32.441389 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-095e1469-09bc-4291-b82d-74de9e8fc78b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:32.443080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-095e1469-09bc-4291-b82d-74de9e8fc78b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:32.453351 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-095e1469-09bc-4291-b82d-74de9e8fc78b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:32.454214 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-095e1469-09bc-4291-b82d-74de9e8fc78b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:32.455618 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-095e1469-09bc-4291-b82d-74de9e8fc78b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:32.456429 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-095e1469-09bc-4291-b82d-74de9e8fc78b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:32.603513 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-095e1469-09bc-4291-b82d-74de9e8fc78b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:32.613580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-095e1469-09bc-4291-b82d-74de9e8fc78b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1679 microversion: 2.1 time: 0.179748 Jun 16 16:16:32.614333 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 243/490] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:32 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:33.632508 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e7f7daf3-3c5a-49a4-b68a-92784677295e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:33.633563 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e7f7daf3-3c5a-49a4-b68a-92784677295e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:33.641214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e7f7daf3-3c5a-49a4-b68a-92784677295e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:33.641707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e7f7daf3-3c5a-49a4-b68a-92784677295e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:33.642535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e7f7daf3-3c5a-49a4-b68a-92784677295e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:33.642977 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e7f7daf3-3c5a-49a4-b68a-92784677295e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:33.823991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e7f7daf3-3c5a-49a4-b68a-92784677295e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:33.837528 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e7f7daf3-3c5a-49a4-b68a-92784677295e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1679 microversion: 2.1 time: 0.209730 Jun 16 16:16:33.838717 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 248/491] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:33 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1679 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:34.860062 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bda159b3-93fa-4b47-8923-803a7bd52c08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:34.861178 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bda159b3-93fa-4b47-8923-803a7bd52c08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:34.872751 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bda159b3-93fa-4b47-8923-803a7bd52c08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:34.873579 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bda159b3-93fa-4b47-8923-803a7bd52c08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:34.875054 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bda159b3-93fa-4b47-8923-803a7bd52c08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:34.876008 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bda159b3-93fa-4b47-8923-803a7bd52c08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:35.074561 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bda159b3-93fa-4b47-8923-803a7bd52c08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:35.085600 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bda159b3-93fa-4b47-8923-803a7bd52c08 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1679 microversion: 2.1 time: 0.232534 Jun 16 16:16:35.086317 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 244/492] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:34 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:36.106431 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f3c18bb2-538c-43c0-ac6d-370279500598 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:36.107139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f3c18bb2-538c-43c0-ac6d-370279500598 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:36.115602 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f3c18bb2-538c-43c0-ac6d-370279500598 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:36.116529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f3c18bb2-538c-43c0-ac6d-370279500598 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:36.117678 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f3c18bb2-538c-43c0-ac6d-370279500598 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:36.118331 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f3c18bb2-538c-43c0-ac6d-370279500598 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:36.425242 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f3c18bb2-538c-43c0-ac6d-370279500598 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:36.437016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f3c18bb2-538c-43c0-ac6d-370279500598 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1679 microversion: 2.1 time: 0.335628 Jun 16 16:16:36.437609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 249/493] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:36 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1679 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:37.374678 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-2c771f9a-329b-4da7-8071-b8ffd6b24270 req-15160e58-9593-4f94-ac21-70671587c9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65f1126e-5b19-4b56-aa87-c4be0b53eb85", "name": "network-vif-deleted", "tag": "1e1c5a67-e2e5-4c4d-9bb0-aaeddbf28281"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:37.393185 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-2c771f9a-329b-4da7-8071-b8ffd6b24270 req-15160e58-9593-4f94-ac21-70671587c9dd service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:37.393824 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-2c771f9a-329b-4da7-8071-b8ffd6b24270 req-15160e58-9593-4f94-ac21-70671587c9dd service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:37.422729 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-2c771f9a-329b-4da7-8071-b8ffd6b24270 req-15160e58-9593-4f94-ac21-70671587c9dd service nova] Creating event network-vif-deleted:1e1c5a67-e2e5-4c4d-9bb0-aaeddbf28281 for instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 on hv-cinder-83716 Jun 16 16:16:37.434373 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-2c771f9a-329b-4da7-8071-b8ffd6b24270 req-15160e58-9593-4f94-ac21-70671587c9dd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066940 Jun 16 16:16:37.440556 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 245/494] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:37.457600 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6ca4cd6a-6fe4-4309-a92c-b46110e497fd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:37.458939 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6ca4cd6a-6fe4-4309-a92c-b46110e497fd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:37.477958 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ca4cd6a-6fe4-4309-a92c-b46110e497fd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:37.478884 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ca4cd6a-6fe4-4309-a92c-b46110e497fd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:37.490550 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ca4cd6a-6fe4-4309-a92c-b46110e497fd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:37.491235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ca4cd6a-6fe4-4309-a92c-b46110e497fd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:37.567195 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ca4cd6a-6fe4-4309-a92c-b46110e497fd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:37.569238 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ca4cd6a-6fe4-4309-a92c-b46110e497fd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:37.569612 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-6ca4cd6a-6fe4-4309-a92c-b46110e497fd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lazy-loading 'fault' on Instance uuid 65f1126e-5b19-4b56-aa87-c4be0b53eb85 {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:16:37.631721 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6ca4cd6a-6fe4-4309-a92c-b46110e497fd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:37.650760 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6ca4cd6a-6fe4-4309-a92c-b46110e497fd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 200 len: 1330 microversion: 2.1 time: 0.195422 Jun 16 16:16:37.651340 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 250/495] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:37 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 1330 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:38.676437 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-017f9122-8be6-4f36-980b-81aedf80afea tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:38.678047 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-017f9122-8be6-4f36-980b-81aedf80afea tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:38.688122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-017f9122-8be6-4f36-980b-81aedf80afea tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:38.688772 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-017f9122-8be6-4f36-980b-81aedf80afea tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:38.691000 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-017f9122-8be6-4f36-980b-81aedf80afea tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:38.691000 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-017f9122-8be6-4f36-980b-81aedf80afea tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:38.722281 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-017f9122-8be6-4f36-980b-81aedf80afea tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] HTTP exception thrown: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-017f9122-8be6-4f36-980b-81aedf80afea tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Request method failure captured: Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 HTTP/1.1 Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ZUq1kgzW_sDLNXIMMrLIuaVIQDyIYyD_QFPpTquNy4hAl_e3YmJtCQ9vDG5Gi9dl3M7alwHb45g-Cko2VZfCdciDPJaW1quIm5ySkHotQHkgN6wNvH9ZeEMkPp9RFHfNBz6m-xTNRiXVTSKnJGaGWLNz7_WuUCsTsM3KjkFbV_vCQ Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:16:38.726960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:16:38.730005 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}] Jun 16 16:16:38.730005 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:16:38.730005 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:16:38.730005 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:16:38.730005 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:16:38.730005 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:16:38.730005 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:16:38.730005 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 2c34f05634d34da29088bcf75069958d Jun 16 16:16:38.730005 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:16:38.730005 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:16:38.730005 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. Jun 16 16:16:38.730005 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': '65f1126e-5b19-4b56-aa87-c4be0b53eb85'} Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:16:38.731372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. Jun 16 16:16:38.733591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:16:38.736605 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-017f9122-8be6-4f36-980b-81aedf80afea tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Returning 404 to user: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:16:38.736605 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-017f9122-8be6-4f36-980b-81aedf80afea tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 404 len: 111 microversion: 2.1 time: 0.057548 Jun 16 16:16:38.736605 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 246/496] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:38 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:16:38.753194 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d976d09b-984d-4fa1-b78d-d06301730355 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '.version_select at 0x7f38bb75fb80>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:38.791082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d976d09b-984d-4fa1-b78d-d06301730355 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-774743181" status: 202 len: 0 microversion: 2.1 time: 0.053251 Jun 16 16:16:38.792278 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 251/497] 10.222.0.17 () {58 vars in 1217 bytes} [Thu Jun 16 16:16:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-774743181 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:16:39.771039 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-01d06de2-3fa5-460e-92a0-bee900014b3e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:39.771781 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-01d06de2-3fa5-460e-92a0-bee900014b3e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:39.778500 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01d06de2-3fa5-460e-92a0-bee900014b3e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:39.778953 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01d06de2-3fa5-460e-92a0-bee900014b3e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:39.779738 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01d06de2-3fa5-460e-92a0-bee900014b3e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:39.780183 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-01d06de2-3fa5-460e-92a0-bee900014b3e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:40.204612 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-01d06de2-3fa5-460e-92a0-bee900014b3e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lazy-loading 'services' on Instance uuid e263395e-8f5e-4b76-85de-41bf42f947ae {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:16:40.351935 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-01d06de2-3fa5-460e-92a0-bee900014b3e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/os-volume_attachments/f368a239-bfb0-4b6e-93d7-47344909eb3a" status: 202 len: 0 microversion: 2.1 time: 0.584613 Jun 16 16:16:40.352488 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 247/498] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 16:16:39 2022] DELETE /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/os-volume_attachments/f368a239-bfb0-4b6e-93d7-47344909eb3a => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:16:40.361740 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6472b68f-989c-47dc-9827-f72d65221135 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:40.362716 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6472b68f-989c-47dc-9827-f72d65221135 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:40.371937 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6472b68f-989c-47dc-9827-f72d65221135 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:40.372403 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6472b68f-989c-47dc-9827-f72d65221135 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:40.373215 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6472b68f-989c-47dc-9827-f72d65221135 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:40.373630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6472b68f-989c-47dc-9827-f72d65221135 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:40.407832 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6472b68f-989c-47dc-9827-f72d65221135 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050605 Jun 16 16:16:40.408412 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 252/499] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:16:40 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:41.422346 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f5fa073a-b814-4c0a-91ba-6a33b25dafa7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:41.423425 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f5fa073a-b814-4c0a-91ba-6a33b25dafa7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:41.433257 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5fa073a-b814-4c0a-91ba-6a33b25dafa7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:41.434497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5fa073a-b814-4c0a-91ba-6a33b25dafa7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:41.435720 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5fa073a-b814-4c0a-91ba-6a33b25dafa7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:41.436414 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5fa073a-b814-4c0a-91ba-6a33b25dafa7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:41.490834 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f5fa073a-b814-4c0a-91ba-6a33b25dafa7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072109 Jun 16 16:16:41.491597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 248/500] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:16:41 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:42.511115 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-42b6aeed-68ba-4693-b153-73a75949b395 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:42.514542 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-42b6aeed-68ba-4693-b153-73a75949b395 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:42.527933 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-42b6aeed-68ba-4693-b153-73a75949b395 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:42.528504 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-42b6aeed-68ba-4693-b153-73a75949b395 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:42.529767 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-42b6aeed-68ba-4693-b153-73a75949b395 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:42.530551 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-42b6aeed-68ba-4693-b153-73a75949b395 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:42.587486 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-42b6aeed-68ba-4693-b153-73a75949b395 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084087 Jun 16 16:16:42.588533 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 253/501] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:16:42 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:43.608142 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e84a651f-cb2e-4d73-9869-1b4da306e84e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:43.610720 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e84a651f-cb2e-4d73-9869-1b4da306e84e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:43.630351 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e84a651f-cb2e-4d73-9869-1b4da306e84e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:43.631087 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e84a651f-cb2e-4d73-9869-1b4da306e84e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:43.632191 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e84a651f-cb2e-4d73-9869-1b4da306e84e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:43.633011 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e84a651f-cb2e-4d73-9869-1b4da306e84e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:43.706829 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e84a651f-cb2e-4d73-9869-1b4da306e84e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105775 Jun 16 16:16:43.708646 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 249/502] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:16:43 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:16:43.811687 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-2ca4ed89-e14e-4092-a6ec-d9a954de05f6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:43.812672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2ca4ed89-e14e-4092-a6ec-d9a954de05f6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:43.822986 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2ca4ed89-e14e-4092-a6ec-d9a954de05f6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:43.823440 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2ca4ed89-e14e-4092-a6ec-d9a954de05f6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:43.824233 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2ca4ed89-e14e-4092-a6ec-d9a954de05f6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:43.824688 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2ca4ed89-e14e-4092-a6ec-d9a954de05f6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:43.870649 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2ca4ed89-e14e-4092-a6ec-d9a954de05f6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Going to try to terminate instance {{(pid=117756) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:16:44.040517 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-2ca4ed89-e14e-4092-a6ec-d9a954de05f6 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 204 len: 0 microversion: 2.1 time: 0.230438 Jun 16 16:16:44.041750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 254/503] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:16:43 2022] DELETE /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:16:44.056622 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-134ff9a6-715e-4c4e-962c-487544961ec7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:44.057789 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-134ff9a6-715e-4c4e-962c-487544961ec7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:44.069306 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-134ff9a6-715e-4c4e-962c-487544961ec7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:44.070053 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-134ff9a6-715e-4c4e-962c-487544961ec7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:44.071462 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-134ff9a6-715e-4c4e-962c-487544961ec7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:44.072253 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-134ff9a6-715e-4c4e-962c-487544961ec7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:44.339917 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-134ff9a6-715e-4c4e-962c-487544961ec7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:44.353640 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-134ff9a6-715e-4c4e-962c-487544961ec7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1679 microversion: 2.1 time: 0.304575 Jun 16 16:16:44.354990 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 250/504] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:44 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1679 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:45.381430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6ccbe09a-361e-445b-918f-b519a7fad5b0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:45.382415 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6ccbe09a-361e-445b-918f-b519a7fad5b0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:45.391988 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ccbe09a-361e-445b-918f-b519a7fad5b0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:45.392503 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ccbe09a-361e-445b-918f-b519a7fad5b0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:45.393432 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ccbe09a-361e-445b-918f-b519a7fad5b0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:45.394059 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6ccbe09a-361e-445b-918f-b519a7fad5b0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:45.693029 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6ccbe09a-361e-445b-918f-b519a7fad5b0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:45.707334 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6ccbe09a-361e-445b-918f-b519a7fad5b0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1679 microversion: 2.1 time: 0.331290 Jun 16 16:16:45.708326 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 255/505] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:45 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1679 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:46.732101 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-776fa766-c532-4bce-b14f-af51e6e38f77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:46.733166 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-776fa766-c532-4bce-b14f-af51e6e38f77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:46.757716 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-776fa766-c532-4bce-b14f-af51e6e38f77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:46.758732 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-776fa766-c532-4bce-b14f-af51e6e38f77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:46.760107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-776fa766-c532-4bce-b14f-af51e6e38f77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:46.760869 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-776fa766-c532-4bce-b14f-af51e6e38f77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:46.968070 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-776fa766-c532-4bce-b14f-af51e6e38f77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:46.980266 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-776fa766-c532-4bce-b14f-af51e6e38f77 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1679 microversion: 2.1 time: 0.253668 Jun 16 16:16:46.981299 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 251/506] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:46 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1679 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:48.005883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-977f730a-0d20-40ad-852d-7bb9ae97a224 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:48.010767 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-977f730a-0d20-40ad-852d-7bb9ae97a224 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:48.027749 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-977f730a-0d20-40ad-852d-7bb9ae97a224 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:48.028215 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-977f730a-0d20-40ad-852d-7bb9ae97a224 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:48.029068 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-977f730a-0d20-40ad-852d-7bb9ae97a224 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:48.029515 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-977f730a-0d20-40ad-852d-7bb9ae97a224 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:48.231510 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-977f730a-0d20-40ad-852d-7bb9ae97a224 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:48.255360 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-977f730a-0d20-40ad-852d-7bb9ae97a224 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1612 microversion: 2.1 time: 0.256837 Jun 16 16:16:48.257430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 256/507] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:47 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1612 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:48.690271 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-fe46cd20-266d-4434-b9a3-1ed8acbcc84e req-ae620711-14aa-4270-a358-ef1515721246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e263395e-8f5e-4b76-85de-41bf42f947ae", "name": "network-vif-deleted", "tag": "bef1a992-09d2-465a-ab42-4a79a9fd1971"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:48.721692 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-fe46cd20-266d-4434-b9a3-1ed8acbcc84e req-ae620711-14aa-4270-a358-ef1515721246 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:48.722678 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-fe46cd20-266d-4434-b9a3-1ed8acbcc84e req-ae620711-14aa-4270-a358-ef1515721246 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:48.765658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-fe46cd20-266d-4434-b9a3-1ed8acbcc84e req-ae620711-14aa-4270-a358-ef1515721246 service nova] Creating event network-vif-deleted:bef1a992-09d2-465a-ab42-4a79a9fd1971 for instance e263395e-8f5e-4b76-85de-41bf42f947ae on hv-cinder-83716 Jun 16 16:16:48.797678 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-fe46cd20-266d-4434-b9a3-1ed8acbcc84e req-ae620711-14aa-4270-a358-ef1515721246 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134392 Jun 16 16:16:48.800013 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 252/508] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:49.279016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-9db36534-8bb8-4df2-b982-e3eef5cd966f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:49.281006 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-9db36534-8bb8-4df2-b982-e3eef5cd966f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:49.293317 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9db36534-8bb8-4df2-b982-e3eef5cd966f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:49.293782 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9db36534-8bb8-4df2-b982-e3eef5cd966f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:49.294810 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9db36534-8bb8-4df2-b982-e3eef5cd966f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:49.295341 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9db36534-8bb8-4df2-b982-e3eef5cd966f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:49.364567 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9db36534-8bb8-4df2-b982-e3eef5cd966f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:49.365820 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9db36534-8bb8-4df2-b982-e3eef5cd966f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:49.366657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-9db36534-8bb8-4df2-b982-e3eef5cd966f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lazy-loading 'fault' on Instance uuid e263395e-8f5e-4b76-85de-41bf42f947ae {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:16:49.459425 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-9db36534-8bb8-4df2-b982-e3eef5cd966f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:49.474572 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-9db36534-8bb8-4df2-b982-e3eef5cd966f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 200 len: 1330 microversion: 2.1 time: 0.201055 Jun 16 16:16:49.490777 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 257/509] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:49 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 1330 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:50.511309 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e6356a29-2087-4a13-8fa6-a7cda55827f1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:50.512450 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e6356a29-2087-4a13-8fa6-a7cda55827f1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:50.529211 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e6356a29-2087-4a13-8fa6-a7cda55827f1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:50.529881 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e6356a29-2087-4a13-8fa6-a7cda55827f1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:50.531323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e6356a29-2087-4a13-8fa6-a7cda55827f1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:50.532385 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e6356a29-2087-4a13-8fa6-a7cda55827f1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:50.554276 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-e6356a29-2087-4a13-8fa6-a7cda55827f1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] HTTP exception thrown: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e6356a29-2087-4a13-8fa6-a7cda55827f1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Request method failure captured: Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae HTTP/1.1 Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ZUq1kgzW_sDLNXIMMrLIuaVIQDyIYyD_QFPpTquNy4hAl_e3YmJtCQ9vDG5Gi9dl3M7alwHb45g-Cko2VZfCdciDPJaW1quIm5ySkHotQHkgN6wNvH9ZeEMkPp9RFHfNBz6m-xTNRiXVTSKnJGaGWLNz7_WuUCsTsM3KjkFbV_vCQ Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:16:50.557971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:16:50.559551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}] Jun 16 16:16:50.559551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:16:50.559551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:16:50.559551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:16:50.559551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:16:50.559551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:16:50.559551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:16:50.559551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 2c34f05634d34da29088bcf75069958d Jun 16 16:16:50.559551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:16:50.559551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:16:50.559551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. Jun 16 16:16:50.559551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': 'e263395e-8f5e-4b76-85de-41bf42f947ae'} Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:16:50.560435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. Jun 16 16:16:50.561820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:16:50.563278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e6356a29-2087-4a13-8fa6-a7cda55827f1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Returning 404 to user: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:16:50.563278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e6356a29-2087-4a13-8fa6-a7cda55827f1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 404 len: 111 microversion: 2.1 time: 0.058474 Jun 16 16:16:50.563278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 253/510] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:50 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:16:50.575564 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a4f97ca4-ee2b-484c-bfee-5219946e26ab tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '.version_select at 0x7f38bb7203a0>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:50.618916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a4f97ca4-ee2b-484c-bfee-5219946e26ab tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-831620920" status: 202 len: 0 microversion: 2.1 time: 0.051605 Jun 16 16:16:50.619871 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 258/511] 10.222.0.17 () {58 vars in 1217 bytes} [Thu Jun 16 16:16:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-831620920 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:16:52.140919 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d8792450-b91d-4770-9be9-38a200951b3b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Action: 'create', calling method: .version_select at 0x7f38bb554790>, body: {"keypair": {"name": "tempest-keypair-365075842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrm3KXhx5uCvMjJeIsyHqHjhEdb7lCwufjZggYLOR5lkKd6jutsHXtU7Sv3E6ufNabsWdDD7f4xHyu79VvRtlcyZHxCMsbWjIJu1lVekLiDfpWc5fK0VLTOM705QTAMbA=="}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:52.174578 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-d8792450-b91d-4770-9be9-38a200951b3b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for project b091584c67814e4d8f7e88f0596880e3. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:16:52.181877 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-d8792450-b91d-4770-9be9-38a200951b3b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for user 2c34f05634d34da29088bcf75069958d and project b091584c67814e4d8f7e88f0596880e3. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:16:52.229917 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d8792450-b91d-4770-9be9-38a200951b3b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.095648 Jun 16 16:16:52.231433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 254/512] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 16:16:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:54.038206 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-891860402", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "networks": [{"uuid": "f7d4ecdc-bb0f-456d-aa92-24e4392aa63f"}]}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:54.111903 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.network.neutron [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] validate_networks() for [('f7d4ecdc-bb0f-456d-aa92-24e4392aa63f', None, None, None, None, None)] {{(pid=117756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:16:54.333088 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1343827831", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cdb4f4d1-8b7f-401f-9aab-5045d67bace2"}], "security_groups": [{"name": "tempest-securitygroup--1109266272"}], "key_name": "tempest-keypair-365075842", "user_data": "}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:54.503806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] validate_networks() for [('cdb4f4d1-8b7f-401f-9aab-5045d67bace2', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:16:54.622942 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Flavor limits 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:16:54.623758 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Image limits 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:16:54.624276 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Flavor pref 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:16:54.624718 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Image pref 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:16:54.628168 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:16:54.637103 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:54.637698 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:54.638418 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:54.638857 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:54.671565 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Getting quotas for project cb4bbded2b5a4d5fa7760540cfa123f7. Resources: {'instances', 'cores', 'ram'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:16:54.678431 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Getting quotas for user ff118e281f40435d8a8253ad10a9042f and project cb4bbded2b5a4d5fa7760540cfa123f7. Resources: {'instances', 'cores', 'ram'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:16:54.697946 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Going to run 1 instances... {{(pid=117756) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:16:54.701683 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:16:54.764435 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-07f8489d-b61b-4018-9a85-8ac199e66fc0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732306 Jun 16 16:16:54.765487 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 259/513] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:16:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:16:54.786660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-278db7d6-3435-4f8c-8308-24f2dc5a4ad0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:54.786660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-278db7d6-3435-4f8c-8308-24f2dc5a4ad0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:54.875558 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-278db7d6-3435-4f8c-8308-24f2dc5a4ad0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:54.886871 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-278db7d6-3435-4f8c-8308-24f2dc5a4ad0 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1218 microversion: 2.1 time: 0.110508 Jun 16 16:16:54.887470 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 260/514] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:54 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:55.098563 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:16:55.099262 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:16:55.099872 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:16:55.100382 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:16:55.100897 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:16:55.114916 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:55.115601 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:55.116806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:55.117440 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:55.146161 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for project b091584c67814e4d8f7e88f0596880e3. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:16:55.153273 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for user 2c34f05634d34da29088bcf75069958d and project b091584c67814e4d8f7e88f0596880e3. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:16:55.171290 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:16:55.173960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:16:55.242171 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-388ced99-a555-4985-8795-0b9f1bf762c9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.914945 Jun 16 16:16:55.243275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 255/515] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:16:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 16:16:55.256473 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d5e63f31-2d8c-41c4-8bf2-801d10ee02d1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:55.257526 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d5e63f31-2d8c-41c4-8bf2-801d10ee02d1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:55.373809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d5e63f31-2d8c-41c4-8bf2-801d10ee02d1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:55.385583 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d5e63f31-2d8c-41c4-8bf2-801d10ee02d1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1241 microversion: 2.1 time: 0.133421 Jun 16 16:16:55.386541 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 261/516] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:55 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1241 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:55.909236 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-cab414b8-5fe5-4b78-88c1-8923a90c8674 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:55.910492 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-cab414b8-5fe5-4b78-88c1-8923a90c8674 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:55.921225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cab414b8-5fe5-4b78-88c1-8923a90c8674 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:55.921827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cab414b8-5fe5-4b78-88c1-8923a90c8674 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:55.922945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cab414b8-5fe5-4b78-88c1-8923a90c8674 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:55.923458 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cab414b8-5fe5-4b78-88c1-8923a90c8674 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:56.021984 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cab414b8-5fe5-4b78-88c1-8923a90c8674 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:56.036668 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-cab414b8-5fe5-4b78-88c1-8923a90c8674 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1270 microversion: 2.1 time: 0.134113 Jun 16 16:16:56.037084 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 256/517] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:55 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:56.414915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3ca115de-a11a-47c6-9269-cc786c5d1ca0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:56.415834 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3ca115de-a11a-47c6-9269-cc786c5d1ca0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:56.430413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3ca115de-a11a-47c6-9269-cc786c5d1ca0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:56.431770 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3ca115de-a11a-47c6-9269-cc786c5d1ca0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:56.433538 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3ca115de-a11a-47c6-9269-cc786c5d1ca0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:56.434451 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3ca115de-a11a-47c6-9269-cc786c5d1ca0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:56.546527 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3ca115de-a11a-47c6-9269-cc786c5d1ca0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:56.558884 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3ca115de-a11a-47c6-9269-cc786c5d1ca0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1237 microversion: 2.1 time: 0.148883 Jun 16 16:16:56.559542 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 262/518] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:56 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1237 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:57.065660 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b14696db-5309-43b2-b80c-21ca4ca2c104 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:57.067534 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b14696db-5309-43b2-b80c-21ca4ca2c104 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:57.079365 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b14696db-5309-43b2-b80c-21ca4ca2c104 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:57.080709 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b14696db-5309-43b2-b80c-21ca4ca2c104 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:57.082247 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b14696db-5309-43b2-b80c-21ca4ca2c104 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:57.084141 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b14696db-5309-43b2-b80c-21ca4ca2c104 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:57.211265 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b14696db-5309-43b2-b80c-21ca4ca2c104 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:57.221879 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b14696db-5309-43b2-b80c-21ca4ca2c104 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1276 microversion: 2.1 time: 0.163292 Jun 16 16:16:57.222609 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 257/519] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:57 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1276 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:57.581348 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3828515d-d45d-4fd4-986a-d58c32620f7f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:57.583602 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3828515d-d45d-4fd4-986a-d58c32620f7f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:57.592507 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3828515d-d45d-4fd4-986a-d58c32620f7f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:57.593253 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3828515d-d45d-4fd4-986a-d58c32620f7f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:57.594274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3828515d-d45d-4fd4-986a-d58c32620f7f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:57.594877 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3828515d-d45d-4fd4-986a-d58c32620f7f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:57.620008 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:57.686527 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3828515d-d45d-4fd4-986a-d58c32620f7f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:57.713187 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3828515d-d45d-4fd4-986a-d58c32620f7f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1299 microversion: 2.1 time: 0.139101 Jun 16 16:16:57.714882 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 263/520] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:57 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:58.255845 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b42c4b52-d1fd-4d24-9473-57c21be5f0c5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:58.258457 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b42c4b52-d1fd-4d24-9473-57c21be5f0c5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:58.269682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b42c4b52-d1fd-4d24-9473-57c21be5f0c5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:58.271571 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b42c4b52-d1fd-4d24-9473-57c21be5f0c5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:58.273094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b42c4b52-d1fd-4d24-9473-57c21be5f0c5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:58.273720 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b42c4b52-d1fd-4d24-9473-57c21be5f0c5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:58.572755 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b42c4b52-d1fd-4d24-9473-57c21be5f0c5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:58.584064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b42c4b52-d1fd-4d24-9473-57c21be5f0c5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1318 microversion: 2.1 time: 0.336259 Jun 16 16:16:58.585321 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 258/521] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:58 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:58.637642 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-e06fad14-4176-4dd1-8e5d-bb4980e4786e req-bee2b5db-455b-4317-9bb5-96064d391c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92f12382-4577-4486-99ea-ddc9f6e43e37", "tag": "2c30997e-910b-45d6-b451-86b997261a88"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:58.657052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-e06fad14-4176-4dd1-8e5d-bb4980e4786e req-bee2b5db-455b-4317-9bb5-96064d391c54 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:58.657506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-e06fad14-4176-4dd1-8e5d-bb4980e4786e req-bee2b5db-455b-4317-9bb5-96064d391c54 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:58.680712 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-e06fad14-4176-4dd1-8e5d-bb4980e4786e req-bee2b5db-455b-4317-9bb5-96064d391c54 service nova] Creating event network-changed:2c30997e-910b-45d6-b451-86b997261a88 for instance 92f12382-4577-4486-99ea-ddc9f6e43e37 on hv-cinder-83716 Jun 16 16:16:58.695745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-e06fad14-4176-4dd1-8e5d-bb4980e4786e req-bee2b5db-455b-4317-9bb5-96064d391c54 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067887 Jun 16 16:16:58.697230 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 264/522] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:58.743749 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a6d3b651-623e-4f0b-801e-0786f4655ee3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:58.744724 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a6d3b651-623e-4f0b-801e-0786f4655ee3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:58.755005 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a6d3b651-623e-4f0b-801e-0786f4655ee3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:58.756227 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a6d3b651-623e-4f0b-801e-0786f4655ee3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:58.757595 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a6d3b651-623e-4f0b-801e-0786f4655ee3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:58.758644 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a6d3b651-623e-4f0b-801e-0786f4655ee3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:59.363043 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a6d3b651-623e-4f0b-801e-0786f4655ee3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:59.381790 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a6d3b651-623e-4f0b-801e-0786f4655ee3 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1367 microversion: 2.1 time: 0.647634 Jun 16 16:16:59.383317 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 259/523] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:58 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1367 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:59.609818 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-82b584af-0048-4c07-b27e-be75fc142c60 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:59.611268 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-82b584af-0048-4c07-b27e-be75fc142c60 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:59.627180 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-82b584af-0048-4c07-b27e-be75fc142c60 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:59.627180 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-82b584af-0048-4c07-b27e-be75fc142c60 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:59.627180 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-82b584af-0048-4c07-b27e-be75fc142c60 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:59.627180 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-82b584af-0048-4c07-b27e-be75fc142c60 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:59.906657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-82b584af-0048-4c07-b27e-be75fc142c60 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:59.918615 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-82b584af-0048-4c07-b27e-be75fc142c60 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1318 microversion: 2.1 time: 0.319953 Jun 16 16:16:59.919203 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 265/524] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:59 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:00.096791 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-9c46dbb1-634d-46af-92c8-9c84d07fcdf9 req-37ec6ba3-1547-4747-88eb-73d059d2cd4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e89e07-513d-41ba-982f-b29bbc494ffe", "tag": "de23705d-f0e2-4a20-bc77-f99d6d881c5c"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:00.109561 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-9c46dbb1-634d-46af-92c8-9c84d07fcdf9 req-37ec6ba3-1547-4747-88eb-73d059d2cd4a service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:00.110169 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-9c46dbb1-634d-46af-92c8-9c84d07fcdf9 req-37ec6ba3-1547-4747-88eb-73d059d2cd4a service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:00.136383 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-9c46dbb1-634d-46af-92c8-9c84d07fcdf9 req-37ec6ba3-1547-4747-88eb-73d059d2cd4a service nova] Creating event network-changed:de23705d-f0e2-4a20-bc77-f99d6d881c5c for instance e2e89e07-513d-41ba-982f-b29bbc494ffe on hv-cinder-83716 Jun 16 16:17:00.146220 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-9c46dbb1-634d-46af-92c8-9c84d07fcdf9 req-37ec6ba3-1547-4747-88eb-73d059d2cd4a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054670 Jun 16 16:17:00.147313 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 260/525] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:00.411314 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b4f7a834-b0a7-44df-997a-2fed5a7c9f0e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:00.412366 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b4f7a834-b0a7-44df-997a-2fed5a7c9f0e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:00.423528 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b4f7a834-b0a7-44df-997a-2fed5a7c9f0e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:00.425025 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b4f7a834-b0a7-44df-997a-2fed5a7c9f0e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:00.426616 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b4f7a834-b0a7-44df-997a-2fed5a7c9f0e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:00.427435 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b4f7a834-b0a7-44df-997a-2fed5a7c9f0e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:00.632254 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b4f7a834-b0a7-44df-997a-2fed5a7c9f0e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:00.643599 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b4f7a834-b0a7-44df-997a-2fed5a7c9f0e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1367 microversion: 2.1 time: 0.238126 Jun 16 16:17:00.644252 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 266/526] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:00 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:00.943128 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f379b7b1-5ab8-4281-ab70-e33a4aee8317 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:00.944327 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f379b7b1-5ab8-4281-ab70-e33a4aee8317 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:00.954001 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f379b7b1-5ab8-4281-ab70-e33a4aee8317 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:00.955184 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f379b7b1-5ab8-4281-ab70-e33a4aee8317 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:00.956071 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f379b7b1-5ab8-4281-ab70-e33a4aee8317 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:00.956729 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f379b7b1-5ab8-4281-ab70-e33a4aee8317 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:01.214998 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f379b7b1-5ab8-4281-ab70-e33a4aee8317 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:01.225277 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f379b7b1-5ab8-4281-ab70-e33a4aee8317 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1318 microversion: 2.1 time: 0.290056 Jun 16 16:17:01.234969 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 261/527] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:00 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:01.664894 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ed052cc0-4106-43ff-b8ea-687dc425876d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:01.666391 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ed052cc0-4106-43ff-b8ea-687dc425876d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:01.674776 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ed052cc0-4106-43ff-b8ea-687dc425876d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:01.675955 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ed052cc0-4106-43ff-b8ea-687dc425876d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:01.677006 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ed052cc0-4106-43ff-b8ea-687dc425876d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:01.677512 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ed052cc0-4106-43ff-b8ea-687dc425876d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:01.869355 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ed052cc0-4106-43ff-b8ea-687dc425876d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:01.877814 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ed052cc0-4106-43ff-b8ea-687dc425876d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1367 microversion: 2.1 time: 0.218748 Jun 16 16:17:01.878567 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 267/528] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:01 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:02.243138 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-683e7cc5-8040-4679-a735-188f32e1a092 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:02.244473 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-683e7cc5-8040-4679-a735-188f32e1a092 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:02.252962 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:02.256469 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-683e7cc5-8040-4679-a735-188f32e1a092 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:02.257105 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-683e7cc5-8040-4679-a735-188f32e1a092 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:02.258435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-683e7cc5-8040-4679-a735-188f32e1a092 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:02.259041 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-683e7cc5-8040-4679-a735-188f32e1a092 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:02.264639 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:02.449279 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-683e7cc5-8040-4679-a735-188f32e1a092 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:02.459082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-683e7cc5-8040-4679-a735-188f32e1a092 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1318 microversion: 2.1 time: 0.220520 Jun 16 16:17:02.459813 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 262/529] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:02 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:02.902193 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-39336939-f6b9-4f37-ab3a-6b936be4e128 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:02.903378 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-39336939-f6b9-4f37-ab3a-6b936be4e128 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:02.906884 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:02.918488 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-39336939-f6b9-4f37-ab3a-6b936be4e128 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:02.918980 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-39336939-f6b9-4f37-ab3a-6b936be4e128 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:02.919899 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-39336939-f6b9-4f37-ab3a-6b936be4e128 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:02.920673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-39336939-f6b9-4f37-ab3a-6b936be4e128 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:03.112478 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-39336939-f6b9-4f37-ab3a-6b936be4e128 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:03.123890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-39336939-f6b9-4f37-ab3a-6b936be4e128 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1367 microversion: 2.1 time: 0.230343 Jun 16 16:17:03.124492 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 268/530] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:02 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:03.481012 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8ed16fba-ffaa-4a6e-887e-99313de3b470 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:03.482057 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8ed16fba-ffaa-4a6e-887e-99313de3b470 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:03.490842 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8ed16fba-ffaa-4a6e-887e-99313de3b470 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:03.491453 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8ed16fba-ffaa-4a6e-887e-99313de3b470 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:03.492348 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8ed16fba-ffaa-4a6e-887e-99313de3b470 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:03.493003 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8ed16fba-ffaa-4a6e-887e-99313de3b470 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:03.517537 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-842ae3aa-f833-434b-b729-72465cc34f8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:03.518518 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-842ae3aa-f833-434b-b729-72465cc34f8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:03.527911 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-842ae3aa-f833-434b-b729-72465cc34f8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:03.529230 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-842ae3aa-f833-434b-b729-72465cc34f8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:03.530251 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-842ae3aa-f833-434b-b729-72465cc34f8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:03.530509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-842ae3aa-f833-434b-b729-72465cc34f8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:03.694300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8ed16fba-ffaa-4a6e-887e-99313de3b470 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:03.713607 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8ed16fba-ffaa-4a6e-887e-99313de3b470 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1318 microversion: 2.1 time: 0.236623 Jun 16 16:17:03.715011 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 263/531] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:03 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:03.720555 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-842ae3aa-f833-434b-b729-72465cc34f8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lazy-loading 'services' on Instance uuid 6b69f513-c146-469b-9045-a974844f18cb {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:17:03.899450 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-842ae3aa-f833-434b-b729-72465cc34f8f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/os-volume_attachments/334f3d46-bd7b-4218-ba68-e815b0ac2fd1" status: 202 len: 0 microversion: 2.1 time: 0.387123 Jun 16 16:17:03.900852 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 269/532] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 16:17:03 2022] DELETE /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/os-volume_attachments/334f3d46-bd7b-4218-ba68-e815b0ac2fd1 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:17:04.104625 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-b85bfd90-613a-43ef-87f1-d4072b5ffbea req-fdc2c28a-70bf-4278-8878-a6844b9496d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92f12382-4577-4486-99ea-ddc9f6e43e37", "name": "network-vif-plugged", "status": "completed", "tag": "2c30997e-910b-45d6-b451-86b997261a88"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:04.121153 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-b85bfd90-613a-43ef-87f1-d4072b5ffbea req-fdc2c28a-70bf-4278-8878-a6844b9496d4 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:04.122409 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-b85bfd90-613a-43ef-87f1-d4072b5ffbea req-fdc2c28a-70bf-4278-8878-a6844b9496d4 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:04.145259 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a5288287-6465-449b-953c-9059464d9a72 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:04.146831 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a5288287-6465-449b-953c-9059464d9a72 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:04.147749 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-b85bfd90-613a-43ef-87f1-d4072b5ffbea req-fdc2c28a-70bf-4278-8878-a6844b9496d4 service nova] Creating event network-vif-plugged:2c30997e-910b-45d6-b451-86b997261a88 for instance 92f12382-4577-4486-99ea-ddc9f6e43e37 on hv-cinder-83716 Jun 16 16:17:04.156237 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a5288287-6465-449b-953c-9059464d9a72 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:04.156948 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a5288287-6465-449b-953c-9059464d9a72 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:04.158218 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a5288287-6465-449b-953c-9059464d9a72 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:04.158734 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a5288287-6465-449b-953c-9059464d9a72 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:04.161075 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-b85bfd90-613a-43ef-87f1-d4072b5ffbea req-fdc2c28a-70bf-4278-8878-a6844b9496d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061674 Jun 16 16:17:04.163067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 264/533] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:17:04.374506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a5288287-6465-449b-953c-9059464d9a72 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:04.384154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a5288287-6465-449b-953c-9059464d9a72 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1367 microversion: 2.1 time: 0.246635 Jun 16 16:17:04.385017 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 270/534] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:04 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:04.734861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1c522a57-efc0-47d3-8721-f981f0f0b78b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:04.735998 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1c522a57-efc0-47d3-8721-f981f0f0b78b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:04.744654 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c522a57-efc0-47d3-8721-f981f0f0b78b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:04.745158 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c522a57-efc0-47d3-8721-f981f0f0b78b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:04.746037 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c522a57-efc0-47d3-8721-f981f0f0b78b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:04.746420 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c522a57-efc0-47d3-8721-f981f0f0b78b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:04.843407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-77638fd1-a8cf-429c-bb7d-f1a0af82ba2a tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:04.844891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-77638fd1-a8cf-429c-bb7d-f1a0af82ba2a tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:04.850829 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:04.866637 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77638fd1-a8cf-429c-bb7d-f1a0af82ba2a tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:04.868320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77638fd1-a8cf-429c-bb7d-f1a0af82ba2a tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:04.870527 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77638fd1-a8cf-429c-bb7d-f1a0af82ba2a tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:04.872303 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77638fd1-a8cf-429c-bb7d-f1a0af82ba2a tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:05.013597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1c522a57-efc0-47d3-8721-f981f0f0b78b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:05.016314 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-77638fd1-a8cf-429c-bb7d-f1a0af82ba2a tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "POST /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/action" status: 202 len: 0 microversion: 2.1 time: 0.175311 Jun 16 16:17:05.029697 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1c522a57-efc0-47d3-8721-f981f0f0b78b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1318 microversion: 2.1 time: 0.300732 Jun 16 16:17:05.031738 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 265/535] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:04 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:05.034750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 271/536] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 16:17:04 2022] POST /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:17:05.057364 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-91dc23ef-4639-4664-ac58-f929263e90ae tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:05.058479 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-91dc23ef-4639-4664-ac58-f929263e90ae tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:05.074399 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-91dc23ef-4639-4664-ac58-f929263e90ae tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:05.075217 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-91dc23ef-4639-4664-ac58-f929263e90ae tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:05.077389 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-91dc23ef-4639-4664-ac58-f929263e90ae tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:05.078213 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-91dc23ef-4639-4664-ac58-f929263e90ae tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:05.126927 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=2 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:05.164007 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=10 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:05.317438 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-91dc23ef-4639-4664-ac58-f929263e90ae tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:05.329529 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-91dc23ef-4639-4664-ac58-f929263e90ae tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1752 microversion: 2.1 time: 0.282591 Jun 16 16:17:05.330644 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 266/537] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:05 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1752 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:05.403623 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=10 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:05.410307 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-5ffb1e19-9a0c-4ed8-a808-99539cb611cc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:05.411512 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-5ffb1e19-9a0c-4ed8-a808-99539cb611cc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:05.429054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5ffb1e19-9a0c-4ed8-a808-99539cb611cc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:05.429589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5ffb1e19-9a0c-4ed8-a808-99539cb611cc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:05.430289 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5ffb1e19-9a0c-4ed8-a808-99539cb611cc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:05.431355 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5ffb1e19-9a0c-4ed8-a808-99539cb611cc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:05.698089 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5ffb1e19-9a0c-4ed8-a808-99539cb611cc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:05.710821 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-5ffb1e19-9a0c-4ed8-a808-99539cb611cc tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1367 microversion: 2.1 time: 0.308533 Jun 16 16:17:05.711796 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 272/538] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:05 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:06.056852 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1dc6848e-5a35-46b1-bf6e-e49e89ec6229 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:06.057822 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1dc6848e-5a35-46b1-bf6e-e49e89ec6229 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:06.070508 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1dc6848e-5a35-46b1-bf6e-e49e89ec6229 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.071176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1dc6848e-5a35-46b1-bf6e-e49e89ec6229 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.072590 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1dc6848e-5a35-46b1-bf6e-e49e89ec6229 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.073376 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1dc6848e-5a35-46b1-bf6e-e49e89ec6229 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.210849 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-c4e11600-9cfd-4940-975c-613eefaa7616 req-b8f9c01a-1d9c-4af4-a776-54bbb11265f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e89e07-513d-41ba-982f-b29bbc494ffe", "name": "network-vif-plugged", "status": "completed", "tag": "de23705d-f0e2-4a20-bc77-f99d6d881c5c"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:06.227640 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-c4e11600-9cfd-4940-975c-613eefaa7616 req-b8f9c01a-1d9c-4af4-a776-54bbb11265f3 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.228569 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-c4e11600-9cfd-4940-975c-613eefaa7616 req-b8f9c01a-1d9c-4af4-a776-54bbb11265f3 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.255183 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-c4e11600-9cfd-4940-975c-613eefaa7616 req-b8f9c01a-1d9c-4af4-a776-54bbb11265f3 service nova] Creating event network-vif-plugged:de23705d-f0e2-4a20-bc77-f99d6d881c5c for instance e2e89e07-513d-41ba-982f-b29bbc494ffe on hv-cinder-83716 Jun 16 16:17:06.267801 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-c4e11600-9cfd-4940-975c-613eefaa7616 req-b8f9c01a-1d9c-4af4-a776-54bbb11265f3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063820 Jun 16 16:17:06.269184 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 273/539] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:06.296738 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1dc6848e-5a35-46b1-bf6e-e49e89ec6229 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:06.307614 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8a9c6555-0835-42f6-b47f-26c98b4c5465 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:06.319092 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1dc6848e-5a35-46b1-bf6e-e49e89ec6229 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1318 microversion: 2.1 time: 0.268980 Jun 16 16:17:06.319404 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8a9c6555-0835-42f6-b47f-26c98b4c5465 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.320000 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8a9c6555-0835-42f6-b47f-26c98b4c5465 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.330369 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 267/540] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:06 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:06.363238 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-acde44af-7a82-4bc9-afd5-8594dcb5a5c9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:06.367020 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-acde44af-7a82-4bc9-afd5-8594dcb5a5c9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:06.384996 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-acde44af-7a82-4bc9-afd5-8594dcb5a5c9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.386530 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-acde44af-7a82-4bc9-afd5-8594dcb5a5c9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.388074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-acde44af-7a82-4bc9-afd5-8594dcb5a5c9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.389091 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-acde44af-7a82-4bc9-afd5-8594dcb5a5c9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.440341 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8a9c6555-0835-42f6-b47f-26c98b4c5465 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Going to try to stop instance {{(pid=117756) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 16:17:06.525945 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8a9c6555-0835-42f6-b47f-26c98b4c5465 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "POST /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/action" status: 202 len: 0 microversion: 2.1 time: 0.226039 Jun 16 16:17:06.533276 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 274/541] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 16:17:06 2022] POST /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:17:06.541507 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6597bf62-719f-4b07-a94a-301e1e95b1c7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:06.542497 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6597bf62-719f-4b07-a94a-301e1e95b1c7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:06.551099 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6597bf62-719f-4b07-a94a-301e1e95b1c7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.551381 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6597bf62-719f-4b07-a94a-301e1e95b1c7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.552341 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6597bf62-719f-4b07-a94a-301e1e95b1c7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.553086 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6597bf62-719f-4b07-a94a-301e1e95b1c7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.652755 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-acde44af-7a82-4bc9-afd5-8594dcb5a5c9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:06.664521 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-acde44af-7a82-4bc9-afd5-8594dcb5a5c9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1752 microversion: 2.1 time: 0.310788 Jun 16 16:17:06.665111 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 268/542] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:06 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1752 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:06.737631 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6d2f17de-129f-404d-a69e-0f9dd9f8abc8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:06.739635 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6d2f17de-129f-404d-a69e-0f9dd9f8abc8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:06.751529 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d2f17de-129f-404d-a69e-0f9dd9f8abc8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.752510 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d2f17de-129f-404d-a69e-0f9dd9f8abc8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.757559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d2f17de-129f-404d-a69e-0f9dd9f8abc8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.757559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6d2f17de-129f-404d-a69e-0f9dd9f8abc8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.883779 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6597bf62-719f-4b07-a94a-301e1e95b1c7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:06.899769 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6597bf62-719f-4b07-a94a-301e1e95b1c7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1676 microversion: 2.1 time: 0.362334 Jun 16 16:17:06.901202 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 275/543] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:06 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1676 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:06.999788 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6d2f17de-129f-404d-a69e-0f9dd9f8abc8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:07.010849 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6d2f17de-129f-404d-a69e-0f9dd9f8abc8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1367 microversion: 2.1 time: 0.280062 Jun 16 16:17:07.011472 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 269/544] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:06 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:07.346110 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-840a2b75-5510-420e-847b-a72dabe87259 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:07.346911 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-840a2b75-5510-420e-847b-a72dabe87259 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:07.357762 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-840a2b75-5510-420e-847b-a72dabe87259 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:07.358597 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-840a2b75-5510-420e-847b-a72dabe87259 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:07.359960 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-840a2b75-5510-420e-847b-a72dabe87259 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:07.360501 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-840a2b75-5510-420e-847b-a72dabe87259 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:07.545666 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-840a2b75-5510-420e-847b-a72dabe87259 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:07.554034 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-840a2b75-5510-420e-847b-a72dabe87259 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1506 microversion: 2.1 time: 0.214286 Jun 16 16:17:07.554616 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 276/545] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:07 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:07.697585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b4fc26c8-9b93-4640-921d-ce58b1f81330 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:07.701379 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b4fc26c8-9b93-4640-921d-ce58b1f81330 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:07.731912 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b4fc26c8-9b93-4640-921d-ce58b1f81330 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:07.733558 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b4fc26c8-9b93-4640-921d-ce58b1f81330 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:07.734838 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b4fc26c8-9b93-4640-921d-ce58b1f81330 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:07.735637 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b4fc26c8-9b93-4640-921d-ce58b1f81330 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:07.924912 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-61525685-00ad-43ed-ad78-f5ad8ad867fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:07.924912 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-61525685-00ad-43ed-ad78-f5ad8ad867fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:07.930522 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61525685-00ad-43ed-ad78-f5ad8ad867fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:07.931300 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61525685-00ad-43ed-ad78-f5ad8ad867fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:07.932666 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61525685-00ad-43ed-ad78-f5ad8ad867fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:07.933448 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61525685-00ad-43ed-ad78-f5ad8ad867fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:07.968648 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b4fc26c8-9b93-4640-921d-ce58b1f81330 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:07.983666 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b4fc26c8-9b93-4640-921d-ce58b1f81330 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1752 microversion: 2.1 time: 0.293977 Jun 16 16:17:07.984249 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 270/546] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:07 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1752 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:08.185155 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-61525685-00ad-43ed-ad78-f5ad8ad867fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:08.209018 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-61525685-00ad-43ed-ad78-f5ad8ad867fd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1676 microversion: 2.1 time: 0.287288 Jun 16 16:17:08.223170 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 277/547] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:07 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1676 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:08.297247 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-40b57162-ed4a-4eb8-9a44-0f9f8379e5b5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:08.299589 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-40b57162-ed4a-4eb8-9a44-0f9f8379e5b5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:08.315976 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-40b57162-ed4a-4eb8-9a44-0f9f8379e5b5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:08.317570 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-40b57162-ed4a-4eb8-9a44-0f9f8379e5b5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:08.318803 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-40b57162-ed4a-4eb8-9a44-0f9f8379e5b5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:08.319779 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-40b57162-ed4a-4eb8-9a44-0f9f8379e5b5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:08.556453 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-40b57162-ed4a-4eb8-9a44-0f9f8379e5b5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:08.567638 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-40b57162-ed4a-4eb8-9a44-0f9f8379e5b5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1367 microversion: 2.1 time: 0.540309 Jun 16 16:17:08.568631 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 271/548] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:08 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1367 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:09.016150 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d8000b0b-9b85-4447-be06-13d1aaedaee0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:09.017396 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d8000b0b-9b85-4447-be06-13d1aaedaee0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:09.031962 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d8000b0b-9b85-4447-be06-13d1aaedaee0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:09.032698 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d8000b0b-9b85-4447-be06-13d1aaedaee0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:09.033830 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d8000b0b-9b85-4447-be06-13d1aaedaee0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:09.034320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d8000b0b-9b85-4447-be06-13d1aaedaee0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:09.244695 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9dbfcd90-27d2-4fc1-8dfe-6e7f1e5c681a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:09.246246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9dbfcd90-27d2-4fc1-8dfe-6e7f1e5c681a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:09.256100 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9dbfcd90-27d2-4fc1-8dfe-6e7f1e5c681a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:09.256859 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9dbfcd90-27d2-4fc1-8dfe-6e7f1e5c681a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:09.257824 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9dbfcd90-27d2-4fc1-8dfe-6e7f1e5c681a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:09.258660 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9dbfcd90-27d2-4fc1-8dfe-6e7f1e5c681a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:09.293882 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d8000b0b-9b85-4447-be06-13d1aaedaee0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:09.302604 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:09.314071 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d8000b0b-9b85-4447-be06-13d1aaedaee0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.307047 Jun 16 16:17:09.315107 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 278/549] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:09 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:09.484119 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9dbfcd90-27d2-4fc1-8dfe-6e7f1e5c681a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:09.494124 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9dbfcd90-27d2-4fc1-8dfe-6e7f1e5c681a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1676 microversion: 2.1 time: 0.257568 Jun 16 16:17:09.494843 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 272/550] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:09 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1676 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:09.590912 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fd4f5530-5e7f-48a4-a65b-7ef9d8b4f23a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:09.591639 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-fd4f5530-5e7f-48a4-a65b-7ef9d8b4f23a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:09.603486 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fd4f5530-5e7f-48a4-a65b-7ef9d8b4f23a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:09.603943 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fd4f5530-5e7f-48a4-a65b-7ef9d8b4f23a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:09.604742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fd4f5530-5e7f-48a4-a65b-7ef9d8b4f23a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:09.605212 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fd4f5530-5e7f-48a4-a65b-7ef9d8b4f23a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:09.813022 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fd4f5530-5e7f-48a4-a65b-7ef9d8b4f23a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:09.823084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fd4f5530-5e7f-48a4-a65b-7ef9d8b4f23a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1367 microversion: 2.1 time: 0.237239 Jun 16 16:17:09.824340 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 279/551] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:09 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:10.340686 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-277a3728-75a5-4030-b9e1-787f2dc14080 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:10.342635 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-277a3728-75a5-4030-b9e1-787f2dc14080 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:10.355802 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-277a3728-75a5-4030-b9e1-787f2dc14080 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:10.356612 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-277a3728-75a5-4030-b9e1-787f2dc14080 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:10.358104 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-277a3728-75a5-4030-b9e1-787f2dc14080 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:10.358903 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-277a3728-75a5-4030-b9e1-787f2dc14080 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:10.518433 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-168904e7-d9c8-4f23-ae65-e694de06db79 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:10.519635 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-168904e7-d9c8-4f23-ae65-e694de06db79 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:10.530302 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-168904e7-d9c8-4f23-ae65-e694de06db79 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:10.531199 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-168904e7-d9c8-4f23-ae65-e694de06db79 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:10.532179 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-168904e7-d9c8-4f23-ae65-e694de06db79 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:10.532938 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-168904e7-d9c8-4f23-ae65-e694de06db79 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:10.617127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-277a3728-75a5-4030-b9e1-787f2dc14080 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:10.631788 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-277a3728-75a5-4030-b9e1-787f2dc14080 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.296022 Jun 16 16:17:10.632736 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 273/552] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:10 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:10.784832 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-168904e7-d9c8-4f23-ae65-e694de06db79 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:10.789514 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-168904e7-d9c8-4f23-ae65-e694de06db79 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1676 microversion: 2.1 time: 0.278824 Jun 16 16:17:10.790296 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 280/553] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:10 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1676 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:10.853712 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4be54d86-ea78-4fa6-8142-aca34c1c4b2b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:10.854898 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4be54d86-ea78-4fa6-8142-aca34c1c4b2b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:10.867100 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4be54d86-ea78-4fa6-8142-aca34c1c4b2b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:10.867812 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4be54d86-ea78-4fa6-8142-aca34c1c4b2b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:10.869125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4be54d86-ea78-4fa6-8142-aca34c1c4b2b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:10.869828 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4be54d86-ea78-4fa6-8142-aca34c1c4b2b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:11.090120 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4be54d86-ea78-4fa6-8142-aca34c1c4b2b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:11.107998 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4be54d86-ea78-4fa6-8142-aca34c1c4b2b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1556 microversion: 2.1 time: 0.262000 Jun 16 16:17:11.108800 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 274/554] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:10 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1556 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:11.135504 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3c946fef-36f0-4b77-ac8e-dd5af9c18282 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:11.136095 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3c946fef-36f0-4b77-ac8e-dd5af9c18282 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:11.149979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3c946fef-36f0-4b77-ac8e-dd5af9c18282 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:11.150781 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3c946fef-36f0-4b77-ac8e-dd5af9c18282 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:11.152054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3c946fef-36f0-4b77-ac8e-dd5af9c18282 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:11.152755 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3c946fef-36f0-4b77-ac8e-dd5af9c18282 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:11.301545 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3c946fef-36f0-4b77-ac8e-dd5af9c18282 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175236 Jun 16 16:17:11.302724 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 281/555] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 16:17:11 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:11.664553 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b62879ff-aeb5-433e-8d62-325977603fb8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:11.665692 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b62879ff-aeb5-433e-8d62-325977603fb8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:11.678012 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b62879ff-aeb5-433e-8d62-325977603fb8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:11.679113 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b62879ff-aeb5-433e-8d62-325977603fb8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:11.680257 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b62879ff-aeb5-433e-8d62-325977603fb8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:11.680757 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b62879ff-aeb5-433e-8d62-325977603fb8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:11.816823 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-58e85ddf-c7ae-43cf-8737-3d326419b1e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:11.819761 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-58e85ddf-c7ae-43cf-8737-3d326419b1e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:11.827376 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-58e85ddf-c7ae-43cf-8737-3d326419b1e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:11.829282 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-58e85ddf-c7ae-43cf-8737-3d326419b1e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:11.830645 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-58e85ddf-c7ae-43cf-8737-3d326419b1e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:11.831145 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-58e85ddf-c7ae-43cf-8737-3d326419b1e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:12.067479 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-58e85ddf-c7ae-43cf-8737-3d326419b1e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:12.079383 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-58e85ddf-c7ae-43cf-8737-3d326419b1e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1676 microversion: 2.1 time: 0.270989 Jun 16 16:17:12.079983 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 282/556] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:11 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1676 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:12.135439 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b62879ff-aeb5-433e-8d62-325977603fb8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:12.148113 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b62879ff-aeb5-433e-8d62-325977603fb8 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.491638 Jun 16 16:17:12.149136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 275/557] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:11 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:13.060091 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-2dcf6b5d-da65-4090-abb5-c0e40d841096 req-018f6ef8-cbf1-42b6-ab14-6038d2deab41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e89e07-513d-41ba-982f-b29bbc494ffe", "tag": "de23705d-f0e2-4a20-bc77-f99d6d881c5c"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:13.077628 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-2dcf6b5d-da65-4090-abb5-c0e40d841096 req-018f6ef8-cbf1-42b6-ab14-6038d2deab41 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:13.078597 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-2dcf6b5d-da65-4090-abb5-c0e40d841096 req-018f6ef8-cbf1-42b6-ab14-6038d2deab41 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:13.102631 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-2dcf6b5d-da65-4090-abb5-c0e40d841096 req-018f6ef8-cbf1-42b6-ab14-6038d2deab41 service nova] Creating event network-changed:de23705d-f0e2-4a20-bc77-f99d6d881c5c for instance e2e89e07-513d-41ba-982f-b29bbc494ffe on hv-cinder-83716 Jun 16 16:17:13.112355 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-2dcf6b5d-da65-4090-abb5-c0e40d841096 req-018f6ef8-cbf1-42b6-ab14-6038d2deab41 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059155 Jun 16 16:17:13.114959 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b390e495-bd93-4343-8eec-30fb1b196cd5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:13.115499 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 283/558] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:13.117514 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b390e495-bd93-4343-8eec-30fb1b196cd5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:13.140579 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b390e495-bd93-4343-8eec-30fb1b196cd5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:13.141751 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b390e495-bd93-4343-8eec-30fb1b196cd5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:13.143997 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b390e495-bd93-4343-8eec-30fb1b196cd5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:13.145776 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b390e495-bd93-4343-8eec-30fb1b196cd5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:13.188882 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-0946bf39-f120-4014-aa55-5f9ab7d28bcb tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:13.190826 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-0946bf39-f120-4014-aa55-5f9ab7d28bcb tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:13.206046 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0946bf39-f120-4014-aa55-5f9ab7d28bcb tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:13.207879 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0946bf39-f120-4014-aa55-5f9ab7d28bcb tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:13.208413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0946bf39-f120-4014-aa55-5f9ab7d28bcb tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:13.209190 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0946bf39-f120-4014-aa55-5f9ab7d28bcb tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:13.455328 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b390e495-bd93-4343-8eec-30fb1b196cd5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:13.471479 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b390e495-bd93-4343-8eec-30fb1b196cd5 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1676 microversion: 2.1 time: 0.363690 Jun 16 16:17:13.474220 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 276/559] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:13 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1676 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:13.678807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-0946bf39-f120-4014-aa55-5f9ab7d28bcb tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:13.699768 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-0946bf39-f120-4014-aa55-5f9ab7d28bcb tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.525709 Jun 16 16:17:13.720082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 284/560] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:13 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:14.502511 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5cfd017a-c5ba-44bd-8e2f-675438ca2959 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:14.503304 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5cfd017a-c5ba-44bd-8e2f-675438ca2959 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:14.511499 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5cfd017a-c5ba-44bd-8e2f-675438ca2959 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:14.512400 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5cfd017a-c5ba-44bd-8e2f-675438ca2959 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:14.513336 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5cfd017a-c5ba-44bd-8e2f-675438ca2959 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:14.514036 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5cfd017a-c5ba-44bd-8e2f-675438ca2959 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:14.751806 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f9e87c12-98f7-4844-b00d-9ffc4a7d5461 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:14.763253 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f9e87c12-98f7-4844-b00d-9ffc4a7d5461 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:14.775454 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f9e87c12-98f7-4844-b00d-9ffc4a7d5461 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:14.776382 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f9e87c12-98f7-4844-b00d-9ffc4a7d5461 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:14.777700 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f9e87c12-98f7-4844-b00d-9ffc4a7d5461 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:14.779777 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f9e87c12-98f7-4844-b00d-9ffc4a7d5461 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:14.809071 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5cfd017a-c5ba-44bd-8e2f-675438ca2959 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:14.827262 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5cfd017a-c5ba-44bd-8e2f-675438ca2959 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1676 microversion: 2.1 time: 0.331028 Jun 16 16:17:14.828770 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 277/561] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:14 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1676 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:15.053640 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f9e87c12-98f7-4844-b00d-9ffc4a7d5461 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:15.075220 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f9e87c12-98f7-4844-b00d-9ffc4a7d5461 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.348585 Jun 16 16:17:15.076012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 285/562] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:14 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:15.814680 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-13942c01-f9d5-4166-afc6-63fdbac86e48 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b4f4de0-3b6a-4124-b3a0-e627de5db3e3"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:15.818513 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-13942c01-f9d5-4166-afc6-63fdbac86e48 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:15.833118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-13942c01-f9d5-4166-afc6-63fdbac86e48 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:15.833708 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-13942c01-f9d5-4166-afc6-63fdbac86e48 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:15.835317 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-13942c01-f9d5-4166-afc6-63fdbac86e48 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:15.836136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-13942c01-f9d5-4166-afc6-63fdbac86e48 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:15.858468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-cfffdb6d-ecd3-48d5-9992-12d7158f8851 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:15.859563 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-cfffdb6d-ecd3-48d5-9992-12d7158f8851 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:15.870232 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cfffdb6d-ecd3-48d5-9992-12d7158f8851 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:15.870668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cfffdb6d-ecd3-48d5-9992-12d7158f8851 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:15.871844 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cfffdb6d-ecd3-48d5-9992-12d7158f8851 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:15.872528 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cfffdb6d-ecd3-48d5-9992-12d7158f8851 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:16.069745 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:16.115603 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-cfffdb6d-ecd3-48d5-9992-12d7158f8851 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:16.128042 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-cfffdb6d-ecd3-48d5-9992-12d7158f8851 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1676 microversion: 2.1 time: 0.275165 Jun 16 16:17:16.134379 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 286/563] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:15 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1676 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:16.138194 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ff02ceb4-de6b-4845-9d1e-39c8c71bb2e0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:16.139313 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ff02ceb4-de6b-4845-9d1e-39c8c71bb2e0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:16.155390 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ff02ceb4-de6b-4845-9d1e-39c8c71bb2e0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:16.156461 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ff02ceb4-de6b-4845-9d1e-39c8c71bb2e0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:16.159384 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ff02ceb4-de6b-4845-9d1e-39c8c71bb2e0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:16.160302 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ff02ceb4-de6b-4845-9d1e-39c8c71bb2e0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:16.271773 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-13942c01-f9d5-4166-afc6-63fdbac86e48 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "POST /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.663244 Jun 16 16:17:16.272839 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 278/564] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 16:17:15 2022] POST /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:16.426790 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ff02ceb4-de6b-4845-9d1e-39c8c71bb2e0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:16.443169 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ff02ceb4-de6b-4845-9d1e-39c8c71bb2e0 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.311948 Jun 16 16:17:16.451866 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 287/565] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:16 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:17.163103 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f5d9fa25-16a1-417d-a1b1-1251401a932e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:17.164411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f5d9fa25-16a1-417d-a1b1-1251401a932e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:17.177811 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5d9fa25-16a1-417d-a1b1-1251401a932e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:17.178682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5d9fa25-16a1-417d-a1b1-1251401a932e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:17.180394 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5d9fa25-16a1-417d-a1b1-1251401a932e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:17.181181 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f5d9fa25-16a1-417d-a1b1-1251401a932e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:17.440893 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f5d9fa25-16a1-417d-a1b1-1251401a932e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:17.460351 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f5d9fa25-16a1-417d-a1b1-1251401a932e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1676 microversion: 2.1 time: 0.305396 Jun 16 16:17:17.461838 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 279/566] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:17 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1676 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:17.466048 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c117bca8-fa5d-4445-b8a5-65ad048cf71f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:17.466945 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c117bca8-fa5d-4445-b8a5-65ad048cf71f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:17.478380 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c117bca8-fa5d-4445-b8a5-65ad048cf71f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:17.479005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c117bca8-fa5d-4445-b8a5-65ad048cf71f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:17.480534 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c117bca8-fa5d-4445-b8a5-65ad048cf71f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:17.481177 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c117bca8-fa5d-4445-b8a5-65ad048cf71f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:17.715188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c117bca8-fa5d-4445-b8a5-65ad048cf71f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:17.731591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c117bca8-fa5d-4445-b8a5-65ad048cf71f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.269419 Jun 16 16:17:17.734203 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 288/567] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:17 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:18.491462 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1d16a400-22cd-4537-8096-586c9b554d70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:18.492373 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1d16a400-22cd-4537-8096-586c9b554d70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:18.503559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1d16a400-22cd-4537-8096-586c9b554d70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:18.505499 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1d16a400-22cd-4537-8096-586c9b554d70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:18.506965 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1d16a400-22cd-4537-8096-586c9b554d70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:18.507677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1d16a400-22cd-4537-8096-586c9b554d70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:18.720121 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1d16a400-22cd-4537-8096-586c9b554d70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:18.737179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1d16a400-22cd-4537-8096-586c9b554d70 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1676 microversion: 2.1 time: 0.252648 Jun 16 16:17:18.738071 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 280/568] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:18 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1676 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:18.755134 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3c61e721-f7cf-4408-b91d-314c3bc2faca tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:18.755917 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3c61e721-f7cf-4408-b91d-314c3bc2faca tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:18.765536 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3c61e721-f7cf-4408-b91d-314c3bc2faca tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:18.766319 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3c61e721-f7cf-4408-b91d-314c3bc2faca tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:18.767215 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3c61e721-f7cf-4408-b91d-314c3bc2faca tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:18.767980 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3c61e721-f7cf-4408-b91d-314c3bc2faca tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:19.028299 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3c61e721-f7cf-4408-b91d-314c3bc2faca tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:19.046823 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3c61e721-f7cf-4408-b91d-314c3bc2faca tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.295356 Jun 16 16:17:19.047872 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 289/569] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:18 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:19.767576 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0171ff26-0234-4174-bbf7-7ecd60d7aa44 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:19.768526 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0171ff26-0234-4174-bbf7-7ecd60d7aa44 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:19.780327 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0171ff26-0234-4174-bbf7-7ecd60d7aa44 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:19.781029 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0171ff26-0234-4174-bbf7-7ecd60d7aa44 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:19.782274 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0171ff26-0234-4174-bbf7-7ecd60d7aa44 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:19.782902 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0171ff26-0234-4174-bbf7-7ecd60d7aa44 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:19.994634 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0171ff26-0234-4174-bbf7-7ecd60d7aa44 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:20.004498 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0171ff26-0234-4174-bbf7-7ecd60d7aa44 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1676 microversion: 2.1 time: 0.243100 Jun 16 16:17:20.005417 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 281/570] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:19 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:20.076797 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-51572f34-da82-4727-9771-03e1cc98496f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:20.077641 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-51572f34-da82-4727-9771-03e1cc98496f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:20.088601 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-51572f34-da82-4727-9771-03e1cc98496f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:20.089247 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-51572f34-da82-4727-9771-03e1cc98496f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:20.090544 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-51572f34-da82-4727-9771-03e1cc98496f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:20.091400 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-51572f34-da82-4727-9771-03e1cc98496f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:20.361315 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-51572f34-da82-4727-9771-03e1cc98496f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:20.371792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-51572f34-da82-4727-9771-03e1cc98496f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.301311 Jun 16 16:17:20.372705 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 290/571] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:20 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:21.032424 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1380e7c7-508a-4e93-8d03-eb1c5bc57824 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:21.033751 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1380e7c7-508a-4e93-8d03-eb1c5bc57824 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:21.042373 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1380e7c7-508a-4e93-8d03-eb1c5bc57824 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:21.042828 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1380e7c7-508a-4e93-8d03-eb1c5bc57824 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:21.043662 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1380e7c7-508a-4e93-8d03-eb1c5bc57824 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:21.044406 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1380e7c7-508a-4e93-8d03-eb1c5bc57824 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:21.256828 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1380e7c7-508a-4e93-8d03-eb1c5bc57824 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:21.272728 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1380e7c7-508a-4e93-8d03-eb1c5bc57824 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1676 microversion: 2.1 time: 0.244581 Jun 16 16:17:21.273900 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 282/572] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:21 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:21.400492 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3d31a13c-4ca4-4573-9c0a-9bedd1da772e tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:21.401321 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3d31a13c-4ca4-4573-9c0a-9bedd1da772e tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:21.411512 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3d31a13c-4ca4-4573-9c0a-9bedd1da772e tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:21.412125 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3d31a13c-4ca4-4573-9c0a-9bedd1da772e tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:21.413229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3d31a13c-4ca4-4573-9c0a-9bedd1da772e tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:21.413834 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3d31a13c-4ca4-4573-9c0a-9bedd1da772e tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:21.596971 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3d31a13c-4ca4-4573-9c0a-9bedd1da772e tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:21.606357 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3d31a13c-4ca4-4573-9c0a-9bedd1da772e tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.214263 Jun 16 16:17:21.607127 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 291/573] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:21 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:22.300339 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e144c9ab-e67f-43bd-b880-22a7021f3091 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:22.302140 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e144c9ab-e67f-43bd-b880-22a7021f3091 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:22.310651 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e144c9ab-e67f-43bd-b880-22a7021f3091 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:22.311403 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e144c9ab-e67f-43bd-b880-22a7021f3091 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:22.312844 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e144c9ab-e67f-43bd-b880-22a7021f3091 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:22.313593 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e144c9ab-e67f-43bd-b880-22a7021f3091 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:22.507031 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e144c9ab-e67f-43bd-b880-22a7021f3091 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:22.520528 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e144c9ab-e67f-43bd-b880-22a7021f3091 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1676 microversion: 2.1 time: 0.225519 Jun 16 16:17:22.521524 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 283/574] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:22 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:22.625067 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7af9224b-1d44-41d7-b244-7d6d51aaddd1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:22.625683 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7af9224b-1d44-41d7-b244-7d6d51aaddd1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:22.637323 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7af9224b-1d44-41d7-b244-7d6d51aaddd1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:22.638289 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7af9224b-1d44-41d7-b244-7d6d51aaddd1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:22.639786 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7af9224b-1d44-41d7-b244-7d6d51aaddd1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:22.640540 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7af9224b-1d44-41d7-b244-7d6d51aaddd1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:22.850411 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7af9224b-1d44-41d7-b244-7d6d51aaddd1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:22.863671 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7af9224b-1d44-41d7-b244-7d6d51aaddd1 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.242560 Jun 16 16:17:22.864388 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 292/575] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:22 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:23.544301 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c8638bdd-a6f9-4099-97fe-b47169ce55c9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:23.545100 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c8638bdd-a6f9-4099-97fe-b47169ce55c9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:23.554188 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c8638bdd-a6f9-4099-97fe-b47169ce55c9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:23.554869 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c8638bdd-a6f9-4099-97fe-b47169ce55c9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:23.555672 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c8638bdd-a6f9-4099-97fe-b47169ce55c9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:23.556217 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c8638bdd-a6f9-4099-97fe-b47169ce55c9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:23.757770 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c8638bdd-a6f9-4099-97fe-b47169ce55c9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:23.768732 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c8638bdd-a6f9-4099-97fe-b47169ce55c9 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1653 microversion: 2.1 time: 0.233784 Jun 16 16:17:23.770115 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 284/576] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:23 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1653 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:23.789404 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3773462a-3251-43ee-8ec1-b3440994742b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:23.800242 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3773462a-3251-43ee-8ec1-b3440994742b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:23.802243 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3773462a-3251-43ee-8ec1-b3440994742b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:23.842626 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3773462a-3251-43ee-8ec1-b3440994742b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Going to try to start instance {{(pid=117756) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 16:17:23.888685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-571ea544-e68b-4fd2-9d97-293a7f0732ea tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:23.889775 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-571ea544-e68b-4fd2-9d97-293a7f0732ea tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:23.907528 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3773462a-3251-43ee-8ec1-b3440994742b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "POST /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/action" status: 202 len: 0 microversion: 2.1 time: 0.123839 Jun 16 16:17:23.908778 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 293/577] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 16:17:23 2022] POST /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:17:23.908969 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-571ea544-e68b-4fd2-9d97-293a7f0732ea tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:23.909296 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-571ea544-e68b-4fd2-9d97-293a7f0732ea tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:23.910791 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-571ea544-e68b-4fd2-9d97-293a7f0732ea tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:23.911791 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-571ea544-e68b-4fd2-9d97-293a7f0732ea tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:23.920531 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-5ece95bb-2e5e-4d44-be11-6d48f208e43c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:23.921523 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-5ece95bb-2e5e-4d44-be11-6d48f208e43c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:23.930928 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5ece95bb-2e5e-4d44-be11-6d48f208e43c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:23.931480 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5ece95bb-2e5e-4d44-be11-6d48f208e43c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:23.932389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5ece95bb-2e5e-4d44-be11-6d48f208e43c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:23.932874 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5ece95bb-2e5e-4d44-be11-6d48f208e43c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:24.189682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-571ea544-e68b-4fd2-9d97-293a7f0732ea tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:24.205806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-571ea544-e68b-4fd2-9d97-293a7f0732ea tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.322613 Jun 16 16:17:24.224714 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 285/578] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:23 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:24.234938 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-266e1f09-df5d-47eb-9924-427c89ceda8e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:24.236748 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-266e1f09-df5d-47eb-9924-427c89ceda8e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:24.249037 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-266e1f09-df5d-47eb-9924-427c89ceda8e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:24.249719 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-266e1f09-df5d-47eb-9924-427c89ceda8e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:24.251660 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-266e1f09-df5d-47eb-9924-427c89ceda8e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:24.251887 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-266e1f09-df5d-47eb-9924-427c89ceda8e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:24.303365 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-266e1f09-df5d-47eb-9924-427c89ceda8e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lazy-loading 'flavor' on Instance uuid a915f676-f877-4b53-9061-2b6d5216e40f {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:17:24.372314 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5ece95bb-2e5e-4d44-be11-6d48f208e43c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:24.388063 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-5ece95bb-2e5e-4d44-be11-6d48f208e43c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1662 microversion: 2.1 time: 0.471552 Jun 16 16:17:24.389379 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 294/579] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:23 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1662 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:24.547090 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-266e1f09-df5d-47eb-9924-427c89ceda8e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "POST /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/action" status: 200 len: 32 microversion: 2.1 time: 0.320492 Jun 16 16:17:24.547998 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 286/580] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 16:17:24 2022] POST /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/action => generated 32 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:17:24.564989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-957792df-1812-4da4-9173-cb0a45765cad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:24.567927 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-957792df-1812-4da4-9173-cb0a45765cad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:24.581383 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-957792df-1812-4da4-9173-cb0a45765cad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:24.583223 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-957792df-1812-4da4-9173-cb0a45765cad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:24.584946 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-957792df-1812-4da4-9173-cb0a45765cad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:24.586104 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-957792df-1812-4da4-9173-cb0a45765cad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:24.650620 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:24.961067 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-957792df-1812-4da4-9173-cb0a45765cad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:24.999972 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-957792df-1812-4da4-9173-cb0a45765cad tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.444865 Jun 16 16:17:25.001624 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 295/581] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:24 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:25.239893 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6a270fc1-ac0f-4568-bbe1-22631e1d3aad tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:25.241581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6a270fc1-ac0f-4568-bbe1-22631e1d3aad tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:25.254766 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6a270fc1-ac0f-4568-bbe1-22631e1d3aad tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:25.255593 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6a270fc1-ac0f-4568-bbe1-22631e1d3aad tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:25.257603 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6a270fc1-ac0f-4568-bbe1-22631e1d3aad tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:25.258667 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6a270fc1-ac0f-4568-bbe1-22631e1d3aad tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:25.408025 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a258c3f6-b191-42e8-a9de-7e4a262af303 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:25.408905 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a258c3f6-b191-42e8-a9de-7e4a262af303 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:25.420921 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a258c3f6-b191-42e8-a9de-7e4a262af303 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:25.421723 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a258c3f6-b191-42e8-a9de-7e4a262af303 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:25.423326 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a258c3f6-b191-42e8-a9de-7e4a262af303 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:25.424135 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a258c3f6-b191-42e8-a9de-7e4a262af303 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:25.646814 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a258c3f6-b191-42e8-a9de-7e4a262af303 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:25.661192 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a258c3f6-b191-42e8-a9de-7e4a262af303 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1662 microversion: 2.1 time: 0.256380 Jun 16 16:17:25.662090 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 296/582] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:25 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1662 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:25.827858 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6a270fc1-ac0f-4568-bbe1-22631e1d3aad tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:25.841394 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6a270fc1-ac0f-4568-bbe1-22631e1d3aad tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.610975 Jun 16 16:17:25.842210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 287/583] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:25 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:26.027855 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1562d752-975c-4460-b188-eb305afc390e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:26.028852 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1562d752-975c-4460-b188-eb305afc390e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:26.037276 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1562d752-975c-4460-b188-eb305afc390e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:26.037727 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1562d752-975c-4460-b188-eb305afc390e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:26.038684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1562d752-975c-4460-b188-eb305afc390e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:26.039124 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1562d752-975c-4460-b188-eb305afc390e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:26.262603 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1562d752-975c-4460-b188-eb305afc390e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:26.273052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1562d752-975c-4460-b188-eb305afc390e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.249739 Jun 16 16:17:26.273869 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 297/584] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:26 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:26.688557 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-534b3138-cf5f-40c7-af5c-e4f26667d64f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:26.694559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-534b3138-cf5f-40c7-af5c-e4f26667d64f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:26.701248 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-534b3138-cf5f-40c7-af5c-e4f26667d64f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:26.702096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-534b3138-cf5f-40c7-af5c-e4f26667d64f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:26.703467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-534b3138-cf5f-40c7-af5c-e4f26667d64f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:26.704234 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-534b3138-cf5f-40c7-af5c-e4f26667d64f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:26.866004 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-cebe5dfd-0cc9-4df5-af05-fb6947dc8cf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:26.867133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-cebe5dfd-0cc9-4df5-af05-fb6947dc8cf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:26.878107 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cebe5dfd-0cc9-4df5-af05-fb6947dc8cf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:26.879326 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cebe5dfd-0cc9-4df5-af05-fb6947dc8cf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:26.880682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cebe5dfd-0cc9-4df5-af05-fb6947dc8cf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:26.881423 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cebe5dfd-0cc9-4df5-af05-fb6947dc8cf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:26.890694 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-534b3138-cf5f-40c7-af5c-e4f26667d64f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:26.903221 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-534b3138-cf5f-40c7-af5c-e4f26667d64f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1666 microversion: 2.1 time: 0.216417 Jun 16 16:17:26.903221 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 288/585] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:26 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1666 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:27.078100 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-cebe5dfd-0cc9-4df5-af05-fb6947dc8cf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:27.091365 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-cebe5dfd-0cc9-4df5-af05-fb6947dc8cf2 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.232709 Jun 16 16:17:27.092453 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 298/586] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:26 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:27.297837 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-146dde4d-e8f6-4eed-b6f0-c27a5f078dc5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:27.298693 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-146dde4d-e8f6-4eed-b6f0-c27a5f078dc5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:27.310593 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-146dde4d-e8f6-4eed-b6f0-c27a5f078dc5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:27.311446 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-146dde4d-e8f6-4eed-b6f0-c27a5f078dc5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:27.312834 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-146dde4d-e8f6-4eed-b6f0-c27a5f078dc5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:27.313632 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-146dde4d-e8f6-4eed-b6f0-c27a5f078dc5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:27.480769 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-146dde4d-e8f6-4eed-b6f0-c27a5f078dc5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:27.490315 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-146dde4d-e8f6-4eed-b6f0-c27a5f078dc5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.197348 Jun 16 16:17:27.490971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 289/587] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:27 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:28.113409 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a056abe9-fb82-4c0a-9a54-a9e3e3fc0567 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:28.114202 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a056abe9-fb82-4c0a-9a54-a9e3e3fc0567 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:28.121978 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a056abe9-fb82-4c0a-9a54-a9e3e3fc0567 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:28.122448 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a056abe9-fb82-4c0a-9a54-a9e3e3fc0567 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:28.123234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a056abe9-fb82-4c0a-9a54-a9e3e3fc0567 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:28.123673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a056abe9-fb82-4c0a-9a54-a9e3e3fc0567 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:28.299088 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a056abe9-fb82-4c0a-9a54-a9e3e3fc0567 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:28.309415 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a056abe9-fb82-4c0a-9a54-a9e3e3fc0567 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.202370 Jun 16 16:17:28.310081 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 299/588] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:28 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:28.510198 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-cf73a7d0-4992-4169-a7bf-54a0a5351aa3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:28.510866 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-cf73a7d0-4992-4169-a7bf-54a0a5351aa3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:28.519108 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cf73a7d0-4992-4169-a7bf-54a0a5351aa3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:28.519690 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cf73a7d0-4992-4169-a7bf-54a0a5351aa3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:28.520729 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cf73a7d0-4992-4169-a7bf-54a0a5351aa3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:28.521488 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cf73a7d0-4992-4169-a7bf-54a0a5351aa3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:28.700849 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cf73a7d0-4992-4169-a7bf-54a0a5351aa3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:28.711307 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-cf73a7d0-4992-4169-a7bf-54a0a5351aa3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.206071 Jun 16 16:17:28.712125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 290/589] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:28 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:29.333587 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8fd72173-7587-4d4d-8a08-72469348f0d9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:29.335299 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8fd72173-7587-4d4d-8a08-72469348f0d9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:29.344749 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8fd72173-7587-4d4d-8a08-72469348f0d9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:29.345186 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8fd72173-7587-4d4d-8a08-72469348f0d9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:29.346003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8fd72173-7587-4d4d-8a08-72469348f0d9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:29.346452 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8fd72173-7587-4d4d-8a08-72469348f0d9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:29.536249 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8fd72173-7587-4d4d-8a08-72469348f0d9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:29.551928 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8fd72173-7587-4d4d-8a08-72469348f0d9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1757 microversion: 2.1 time: 0.226434 Jun 16 16:17:29.552937 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 300/590] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:29 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1757 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:29.730772 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-89bd879c-621d-41b3-8f4b-ef8db10c5cbb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:29.731614 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-89bd879c-621d-41b3-8f4b-ef8db10c5cbb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:29.741188 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89bd879c-621d-41b3-8f4b-ef8db10c5cbb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:29.741884 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89bd879c-621d-41b3-8f4b-ef8db10c5cbb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:29.742980 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89bd879c-621d-41b3-8f4b-ef8db10c5cbb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:29.743748 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-89bd879c-621d-41b3-8f4b-ef8db10c5cbb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:29.925362 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-89bd879c-621d-41b3-8f4b-ef8db10c5cbb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:29.942762 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-89bd879c-621d-41b3-8f4b-ef8db10c5cbb tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.216441 Jun 16 16:17:29.943841 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 291/591] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:29 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:30.040076 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7bd87ee7-c94b-4a57-a1d1-cb28400de0d3 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83cb1c4e-d858-4de7-b796-1787bd63000a", "device": "/dev/sdb"}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:30.041867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7bd87ee7-c94b-4a57-a1d1-cb28400de0d3 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:30.048830 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7bd87ee7-c94b-4a57-a1d1-cb28400de0d3 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:30.049567 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7bd87ee7-c94b-4a57-a1d1-cb28400de0d3 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:30.050447 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7bd87ee7-c94b-4a57-a1d1-cb28400de0d3 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:30.050934 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7bd87ee7-c94b-4a57-a1d1-cb28400de0d3 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:30.517622 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7bd87ee7-c94b-4a57-a1d1-cb28400de0d3 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "POST /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481685 Jun 16 16:17:30.518785 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 301/592] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 16:17:30 2022] POST /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:30.585065 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-267cafec-6891-4c76-9de5-cac1db60ebcc tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:30.585528 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-267cafec-6891-4c76-9de5-cac1db60ebcc tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:30.595845 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-267cafec-6891-4c76-9de5-cac1db60ebcc tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:30.596630 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-267cafec-6891-4c76-9de5-cac1db60ebcc tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:30.598565 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-267cafec-6891-4c76-9de5-cac1db60ebcc tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:30.599254 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-267cafec-6891-4c76-9de5-cac1db60ebcc tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:30.814861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-267cafec-6891-4c76-9de5-cac1db60ebcc tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:30.818536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:30.828899 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-267cafec-6891-4c76-9de5-cac1db60ebcc tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1760 microversion: 2.1 time: 0.252783 Jun 16 16:17:30.829621 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 292/593] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:30 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1760 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:30.977080 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-47d7db55-c13a-4ed0-be05-49c3ee97cf25 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:30.978426 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-47d7db55-c13a-4ed0-be05-49c3ee97cf25 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:30.989644 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-47d7db55-c13a-4ed0-be05-49c3ee97cf25 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:30.990373 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-47d7db55-c13a-4ed0-be05-49c3ee97cf25 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:30.991905 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-47d7db55-c13a-4ed0-be05-49c3ee97cf25 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:30.992589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-47d7db55-c13a-4ed0-be05-49c3ee97cf25 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:31.167089 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-47d7db55-c13a-4ed0-be05-49c3ee97cf25 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:31.182859 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-47d7db55-c13a-4ed0-be05-49c3ee97cf25 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.214680 Jun 16 16:17:31.183964 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 302/594] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:30 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:32.211562 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f502f6ad-024d-46e6-972f-cee8c1a342e7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:32.212410 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f502f6ad-024d-46e6-972f-cee8c1a342e7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:32.222526 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f502f6ad-024d-46e6-972f-cee8c1a342e7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:32.222996 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f502f6ad-024d-46e6-972f-cee8c1a342e7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:32.223821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f502f6ad-024d-46e6-972f-cee8c1a342e7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:32.225251 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f502f6ad-024d-46e6-972f-cee8c1a342e7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:32.421695 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f502f6ad-024d-46e6-972f-cee8c1a342e7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:32.437608 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f502f6ad-024d-46e6-972f-cee8c1a342e7 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.230418 Jun 16 16:17:32.438287 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 293/595] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:32 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:33.456001 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-12575db6-56d4-4e7c-a207-685e4d9013df tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:33.457196 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-12575db6-56d4-4e7c-a207-685e4d9013df tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:33.459671 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=70 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:33.465644 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-12575db6-56d4-4e7c-a207-685e4d9013df tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:33.466117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-12575db6-56d4-4e7c-a207-685e4d9013df tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:33.466880 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-12575db6-56d4-4e7c-a207-685e4d9013df tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:33.467311 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-12575db6-56d4-4e7c-a207-685e4d9013df tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:33.623691 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-12575db6-56d4-4e7c-a207-685e4d9013df tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:33.636776 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-12575db6-56d4-4e7c-a207-685e4d9013df tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.184292 Jun 16 16:17:33.637531 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 303/596] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:33 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:34.656604 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-58e2287f-7279-4b0e-8968-45e599c18467 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:34.657465 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-58e2287f-7279-4b0e-8968-45e599c18467 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:34.660200 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=64 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:34.666033 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58e2287f-7279-4b0e-8968-45e599c18467 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:34.666479 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58e2287f-7279-4b0e-8968-45e599c18467 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:34.667233 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58e2287f-7279-4b0e-8968-45e599c18467 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:34.667663 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58e2287f-7279-4b0e-8968-45e599c18467 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:34.840174 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-58e2287f-7279-4b0e-8968-45e599c18467 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:34.854689 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-58e2287f-7279-4b0e-8968-45e599c18467 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.201521 Jun 16 16:17:34.855679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 294/597] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:34 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:35.879255 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f70ad160-d586-4dbf-9034-2981f8f9cf1f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:35.880146 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f70ad160-d586-4dbf-9034-2981f8f9cf1f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:35.890051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f70ad160-d586-4dbf-9034-2981f8f9cf1f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:35.890784 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f70ad160-d586-4dbf-9034-2981f8f9cf1f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:35.892056 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f70ad160-d586-4dbf-9034-2981f8f9cf1f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:35.892801 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f70ad160-d586-4dbf-9034-2981f8f9cf1f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:36.071252 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f70ad160-d586-4dbf-9034-2981f8f9cf1f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:36.085953 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f70ad160-d586-4dbf-9034-2981f8f9cf1f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.210907 Jun 16 16:17:36.086985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 304/598] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:35 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:37.104758 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-882b50ed-9a02-4112-940b-2e054cd67dd0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:37.105376 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-882b50ed-9a02-4112-940b-2e054cd67dd0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:37.112451 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-882b50ed-9a02-4112-940b-2e054cd67dd0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:37.113502 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-882b50ed-9a02-4112-940b-2e054cd67dd0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:37.114322 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-882b50ed-9a02-4112-940b-2e054cd67dd0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:37.114764 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-882b50ed-9a02-4112-940b-2e054cd67dd0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:37.279317 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-882b50ed-9a02-4112-940b-2e054cd67dd0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:37.289919 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-882b50ed-9a02-4112-940b-2e054cd67dd0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.189157 Jun 16 16:17:37.290513 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 295/599] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:37 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:38.318471 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-30de62c8-b860-4b78-9801-0974873474b4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:38.320782 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-30de62c8-b860-4b78-9801-0974873474b4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:38.332854 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-30de62c8-b860-4b78-9801-0974873474b4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:38.335817 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-30de62c8-b860-4b78-9801-0974873474b4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:38.339024 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-30de62c8-b860-4b78-9801-0974873474b4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:38.339841 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-30de62c8-b860-4b78-9801-0974873474b4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:38.516137 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-30de62c8-b860-4b78-9801-0974873474b4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:38.531305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-30de62c8-b860-4b78-9801-0974873474b4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.219675 Jun 16 16:17:38.532314 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 305/600] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:38 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:39.555569 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6b186585-af43-4a97-a62b-b8b96d7a965a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:39.556578 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6b186585-af43-4a97-a62b-b8b96d7a965a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:39.568269 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6b186585-af43-4a97-a62b-b8b96d7a965a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:39.568797 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6b186585-af43-4a97-a62b-b8b96d7a965a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:39.569766 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6b186585-af43-4a97-a62b-b8b96d7a965a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:39.570473 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6b186585-af43-4a97-a62b-b8b96d7a965a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:39.737293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6b186585-af43-4a97-a62b-b8b96d7a965a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:39.752200 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6b186585-af43-4a97-a62b-b8b96d7a965a tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.204027 Jun 16 16:17:39.754246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 296/601] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:39 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:40.774508 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-aefaf7bf-19a8-49b5-b844-b870d9264330 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:40.775314 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-aefaf7bf-19a8-49b5-b844-b870d9264330 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:40.782841 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aefaf7bf-19a8-49b5-b844-b870d9264330 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:40.783288 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aefaf7bf-19a8-49b5-b844-b870d9264330 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:40.784068 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aefaf7bf-19a8-49b5-b844-b870d9264330 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:40.784511 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aefaf7bf-19a8-49b5-b844-b870d9264330 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:40.941161 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-aefaf7bf-19a8-49b5-b844-b870d9264330 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:40.950627 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-aefaf7bf-19a8-49b5-b844-b870d9264330 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.179913 Jun 16 16:17:40.951276 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 306/602] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:40 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:41.970097 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-14c0bbd1-909a-47f2-9867-897faa4e52e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:41.970892 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-14c0bbd1-909a-47f2-9867-897faa4e52e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:41.977592 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-14c0bbd1-909a-47f2-9867-897faa4e52e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:41.978077 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-14c0bbd1-909a-47f2-9867-897faa4e52e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:41.978861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-14c0bbd1-909a-47f2-9867-897faa4e52e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:41.979292 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-14c0bbd1-909a-47f2-9867-897faa4e52e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:42.157532 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-14c0bbd1-909a-47f2-9867-897faa4e52e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:42.168476 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-14c0bbd1-909a-47f2-9867-897faa4e52e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.202251 Jun 16 16:17:42.169133 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 297/603] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:41 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:43.195046 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4ba41fed-08c7-4e4e-9003-df391a8878d3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:43.195660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4ba41fed-08c7-4e4e-9003-df391a8878d3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:43.203514 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4ba41fed-08c7-4e4e-9003-df391a8878d3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:43.203958 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4ba41fed-08c7-4e4e-9003-df391a8878d3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:43.204747 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4ba41fed-08c7-4e4e-9003-df391a8878d3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:43.205235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4ba41fed-08c7-4e4e-9003-df391a8878d3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:43.389221 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4ba41fed-08c7-4e4e-9003-df391a8878d3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:43.398870 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4ba41fed-08c7-4e4e-9003-df391a8878d3 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.208786 Jun 16 16:17:43.399463 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 307/604] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:43 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:44.422436 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8905623b-ac54-4475-b11b-e9a4b27a0777 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:44.423486 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8905623b-ac54-4475-b11b-e9a4b27a0777 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:44.431201 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8905623b-ac54-4475-b11b-e9a4b27a0777 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:44.431662 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8905623b-ac54-4475-b11b-e9a4b27a0777 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:44.432440 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8905623b-ac54-4475-b11b-e9a4b27a0777 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:44.432879 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8905623b-ac54-4475-b11b-e9a4b27a0777 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:44.596494 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8905623b-ac54-4475-b11b-e9a4b27a0777 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:44.605905 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8905623b-ac54-4475-b11b-e9a4b27a0777 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.192143 Jun 16 16:17:44.606670 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 298/605] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:44 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:45.631834 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a5d563c7-75b5-4d3e-b811-e4caf78023fd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:45.632479 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a5d563c7-75b5-4d3e-b811-e4caf78023fd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:45.639695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a5d563c7-75b5-4d3e-b811-e4caf78023fd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:45.640262 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a5d563c7-75b5-4d3e-b811-e4caf78023fd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:45.641134 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a5d563c7-75b5-4d3e-b811-e4caf78023fd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:45.641667 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a5d563c7-75b5-4d3e-b811-e4caf78023fd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:45.824933 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a5d563c7-75b5-4d3e-b811-e4caf78023fd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:45.840245 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a5d563c7-75b5-4d3e-b811-e4caf78023fd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.212435 Jun 16 16:17:45.841282 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 308/606] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:45 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:46.873105 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-951e296f-ca9c-4d10-9720-d6d8c919eb52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:46.873805 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-951e296f-ca9c-4d10-9720-d6d8c919eb52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:46.883756 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-951e296f-ca9c-4d10-9720-d6d8c919eb52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:46.884582 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-951e296f-ca9c-4d10-9720-d6d8c919eb52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:46.885964 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-951e296f-ca9c-4d10-9720-d6d8c919eb52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:46.886595 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-951e296f-ca9c-4d10-9720-d6d8c919eb52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:47.113112 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-951e296f-ca9c-4d10-9720-d6d8c919eb52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:47.130593 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-951e296f-ca9c-4d10-9720-d6d8c919eb52 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.261131 Jun 16 16:17:47.146477 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 299/607] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:46 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:48.156348 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a00cfb09-1d74-4be5-a2d3-cefee60662ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:48.157241 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a00cfb09-1d74-4be5-a2d3-cefee60662ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:48.166273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a00cfb09-1d74-4be5-a2d3-cefee60662ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:48.166784 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a00cfb09-1d74-4be5-a2d3-cefee60662ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:48.167703 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a00cfb09-1d74-4be5-a2d3-cefee60662ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:48.168259 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a00cfb09-1d74-4be5-a2d3-cefee60662ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:48.329002 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a00cfb09-1d74-4be5-a2d3-cefee60662ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:48.341777 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a00cfb09-1d74-4be5-a2d3-cefee60662ef tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.189039 Jun 16 16:17:48.342766 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 309/608] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:48 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:49.366284 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e62456c7-0d6e-4ff2-bdc9-4d95d9daafca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:49.367058 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e62456c7-0d6e-4ff2-bdc9-4d95d9daafca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:49.374492 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e62456c7-0d6e-4ff2-bdc9-4d95d9daafca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:49.375024 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e62456c7-0d6e-4ff2-bdc9-4d95d9daafca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:49.375847 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e62456c7-0d6e-4ff2-bdc9-4d95d9daafca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:49.376327 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e62456c7-0d6e-4ff2-bdc9-4d95d9daafca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:49.529184 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e62456c7-0d6e-4ff2-bdc9-4d95d9daafca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:49.539203 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e62456c7-0d6e-4ff2-bdc9-4d95d9daafca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.177848 Jun 16 16:17:49.539777 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 300/609] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:49 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:50.566403 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e3141c37-d88a-4123-89f6-c1bb95ed07c2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:50.567526 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e3141c37-d88a-4123-89f6-c1bb95ed07c2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:50.579279 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e3141c37-d88a-4123-89f6-c1bb95ed07c2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:50.580113 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e3141c37-d88a-4123-89f6-c1bb95ed07c2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:50.581565 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e3141c37-d88a-4123-89f6-c1bb95ed07c2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:50.582467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e3141c37-d88a-4123-89f6-c1bb95ed07c2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:50.753424 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e3141c37-d88a-4123-89f6-c1bb95ed07c2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:50.759595 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:50.767054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e3141c37-d88a-4123-89f6-c1bb95ed07c2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.208318 Jun 16 16:17:50.767986 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 310/610] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:50 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:51.794631 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a96319b6-ca12-49e2-ac20-5d855777edf2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:51.795482 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a96319b6-ca12-49e2-ac20-5d855777edf2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:51.807162 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a96319b6-ca12-49e2-ac20-5d855777edf2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:51.807715 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a96319b6-ca12-49e2-ac20-5d855777edf2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:51.808753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a96319b6-ca12-49e2-ac20-5d855777edf2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:51.809358 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a96319b6-ca12-49e2-ac20-5d855777edf2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:51.970517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a96319b6-ca12-49e2-ac20-5d855777edf2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:51.982676 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a96319b6-ca12-49e2-ac20-5d855777edf2 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.193438 Jun 16 16:17:51.983271 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 301/611] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:51 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:53.004293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e465bc50-1bdc-40cd-838f-b20df1aa34e8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:53.004986 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e465bc50-1bdc-40cd-838f-b20df1aa34e8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:53.017263 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e465bc50-1bdc-40cd-838f-b20df1aa34e8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:53.018101 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e465bc50-1bdc-40cd-838f-b20df1aa34e8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:53.019079 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e465bc50-1bdc-40cd-838f-b20df1aa34e8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:53.019519 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e465bc50-1bdc-40cd-838f-b20df1aa34e8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:53.209967 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e465bc50-1bdc-40cd-838f-b20df1aa34e8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:53.223198 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e465bc50-1bdc-40cd-838f-b20df1aa34e8 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.224973 Jun 16 16:17:53.223810 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 311/612] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:52 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:54.246155 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b52cb91b-dd2e-463d-a0ac-1b1502c59c44 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:54.246909 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b52cb91b-dd2e-463d-a0ac-1b1502c59c44 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:54.255825 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b52cb91b-dd2e-463d-a0ac-1b1502c59c44 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:54.256278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b52cb91b-dd2e-463d-a0ac-1b1502c59c44 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:54.257059 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b52cb91b-dd2e-463d-a0ac-1b1502c59c44 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:54.257502 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b52cb91b-dd2e-463d-a0ac-1b1502c59c44 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:54.423688 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b52cb91b-dd2e-463d-a0ac-1b1502c59c44 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:54.437248 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b52cb91b-dd2e-463d-a0ac-1b1502c59c44 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1736 microversion: 2.1 time: 0.197583 Jun 16 16:17:54.437916 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 302/613] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:54 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:54.771595 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ccb0b25d-e5e9-4aa0-b43d-091ba6c94b80 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:54.772458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ccb0b25d-e5e9-4aa0-b43d-091ba6c94b80 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:54.782334 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ccb0b25d-e5e9-4aa0-b43d-091ba6c94b80 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:54.782796 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ccb0b25d-e5e9-4aa0-b43d-091ba6c94b80 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:54.784724 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ccb0b25d-e5e9-4aa0-b43d-091ba6c94b80 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:54.785545 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ccb0b25d-e5e9-4aa0-b43d-091ba6c94b80 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:54.900930 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-ccb0b25d-e5e9-4aa0-b43d-091ba6c94b80 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lazy-loading 'services' on Instance uuid 92f12382-4577-4486-99ea-ddc9f6e43e37 {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:17:55.008470 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ccb0b25d-e5e9-4aa0-b43d-091ba6c94b80 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "DELETE /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37/os-volume_attachments/83cb1c4e-d858-4de7-b796-1787bd63000a" status: 202 len: 0 microversion: 2.1 time: 0.240127 Jun 16 16:17:55.009412 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 312/614] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 16:17:54 2022] DELETE /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37/os-volume_attachments/83cb1c4e-d858-4de7-b796-1787bd63000a => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:17:55.458357 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ec284a3c-1ddf-4c63-adae-36eff1373093 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:55.459170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ec284a3c-1ddf-4c63-adae-36eff1373093 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:55.467233 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec284a3c-1ddf-4c63-adae-36eff1373093 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:55.467896 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec284a3c-1ddf-4c63-adae-36eff1373093 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:55.468726 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec284a3c-1ddf-4c63-adae-36eff1373093 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:55.469187 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec284a3c-1ddf-4c63-adae-36eff1373093 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:55.632345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ec284a3c-1ddf-4c63-adae-36eff1373093 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:55.647924 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ec284a3c-1ddf-4c63-adae-36eff1373093 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1716 microversion: 2.1 time: 0.193234 Jun 16 16:17:55.648973 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 303/615] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:55 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1716 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:55.731481 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-65853499-b5f2-433e-9f7b-1d6f242c640b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:55.732139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-65853499-b5f2-433e-9f7b-1d6f242c640b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:55.739587 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-65853499-b5f2-433e-9f7b-1d6f242c640b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:55.740034 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-65853499-b5f2-433e-9f7b-1d6f242c640b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:55.740822 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-65853499-b5f2-433e-9f7b-1d6f242c640b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:55.741254 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-65853499-b5f2-433e-9f7b-1d6f242c640b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:55.842948 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-65853499-b5f2-433e-9f7b-1d6f242c640b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] HTTP exception thrown: Cannot 'detach_volume' instance a915f676-f877-4b53-9061-2b6d5216e40f while it is in vm_state rescued Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-65853499-b5f2-433e-9f7b-1d6f242c640b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Request method failure captured: Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: DELETE /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-volume_attachments/7b4f4de0-3b6a-4124-b3a0-e627de5db3e3 HTTP/1.1 Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ZJY_sf7_CaFp_lO20gYVdqLWXD7KbXNclHWQjc7pFk6nrkQF5CUv-8fhFY_sEa4Cuuwxdq5-z1gFim5Qvs5jD5K3YfctWCEQ53zozYHt_RA-tZlOmWWY7ue5LMWv7eCUbS2DS_i_lm-rWoECV8WYU-ge_gZY1PlPBE00XcuxlXLh4 Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 6eee49063a5847dba6ffb520d0149d88 Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-14364702 Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:17:55.845005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:17:55.852393 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6eee49063a5847dba6ffb520d0149d88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6eee49063a5847dba6ffb520d0149d88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6eee49063a5847dba6ffb520d0149d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6eee49063a5847dba6ffb520d0149d88"}]}] Jun 16 16:17:55.852393 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-ServerRescueNegativeTestJSON-14364702 Jun 16 16:17:55.852393 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 6eee49063a5847dba6ffb520d0149d88 Jun 16 16:17:55.852393 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-14364702 Jun 16 16:17:55.852393 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-ServerRescueNegativeTestJSON-14364702-project Jun 16 16:17:55.852393 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:17:55.852393 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:17:55.852393 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 515114f0a842463fb2d1265ee33db8eb Jun 16 16:17:55.852393 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-ServerRescueNegativeTestJSON-14364702-project Jun 16 16:17:55.852393 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:17:55.852393 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Cannot 'detach_volume' instance a915f676-f877-4b53-9061-2b6d5216e40f while it is in vm_state rescued Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'server_id': 'a915f676-f877-4b53-9061-2b6d5216e40f', 'id': '7b4f4de0-3b6a-4124-b3a0-e627de5db3e3'} Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a915f676-f877-4b53-9061-2b6d5216e40f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:17:55.853229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a915f676-f877-4b53-9061-2b6d5216e40f while it is in vm_state rescued Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a915f676-f877-4b53-9061-2b6d5216e40f while it is in vm_state rescued Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:17:55.854833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-65853499-b5f2-433e-9f7b-1d6f242c640b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Returning 409 to user: Cannot 'detach_volume' instance a915f676-f877-4b53-9061-2b6d5216e40f while it is in vm_state rescued {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:17:55.855995 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-65853499-b5f2-433e-9f7b-1d6f242c640b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-volume_attachments/7b4f4de0-3b6a-4124-b3a0-e627de5db3e3" status: 409 len: 152 microversion: 2.1 time: 0.120226 Jun 16 16:17:55.855995 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 313/616] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 16:17:55 2022] DELETE /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-volume_attachments/7b4f4de0-3b6a-4124-b3a0-e627de5db3e3 => generated 152 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 16:17:55.859939 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0baae6f2-0098-4069-a34f-389ce8383d23 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:55.860479 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0baae6f2-0098-4069-a34f-389ce8383d23 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:55.867972 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0baae6f2-0098-4069-a34f-389ce8383d23 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:55.868593 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0baae6f2-0098-4069-a34f-389ce8383d23 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:55.869898 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0baae6f2-0098-4069-a34f-389ce8383d23 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:55.870598 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0baae6f2-0098-4069-a34f-389ce8383d23 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:55.954557 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0baae6f2-0098-4069-a34f-389ce8383d23 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "POST /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/action" status: 202 len: 0 microversion: 2.1 time: 0.100361 Jun 16 16:17:55.955183 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 304/617] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 16:17:55 2022] POST /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:17:55.968247 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-5489183b-ef85-493b-b3a2-106291624b65 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:55.969642 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-5489183b-ef85-493b-b3a2-106291624b65 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:55.980610 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5489183b-ef85-493b-b3a2-106291624b65 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:55.981353 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5489183b-ef85-493b-b3a2-106291624b65 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:55.982603 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5489183b-ef85-493b-b3a2-106291624b65 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:55.983268 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5489183b-ef85-493b-b3a2-106291624b65 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:56.183615 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5489183b-ef85-493b-b3a2-106291624b65 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:56.198582 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-5489183b-ef85-493b-b3a2-106291624b65 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1724 microversion: 2.1 time: 0.237180 Jun 16 16:17:56.199527 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 314/618] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:55 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:57.230211 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-cc476887-ea48-4b24-af92-47711fb123f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:57.231079 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-cc476887-ea48-4b24-af92-47711fb123f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:57.233515 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1c017598-a736-406d-a662-f21799155e1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:57.234304 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1c017598-a736-406d-a662-f21799155e1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:57.242194 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cc476887-ea48-4b24-af92-47711fb123f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:57.242660 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cc476887-ea48-4b24-af92-47711fb123f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:57.243363 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1c017598-a736-406d-a662-f21799155e1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:57.243570 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cc476887-ea48-4b24-af92-47711fb123f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:57.243890 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cc476887-ea48-4b24-af92-47711fb123f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:57.244071 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1c017598-a736-406d-a662-f21799155e1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:57.245139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1c017598-a736-406d-a662-f21799155e1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:57.245885 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1c017598-a736-406d-a662-f21799155e1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:57.287358 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1c017598-a736-406d-a662-f21799155e1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Going to try to terminate instance {{(pid=117756) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:17:57.399215 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1c017598-a736-406d-a662-f21799155e1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "DELETE /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 204 len: 0 microversion: 2.1 time: 0.169998 Jun 16 16:17:57.399828 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 315/619] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:17:57 2022] DELETE /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:17:57.415416 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-aeb258ff-5097-4646-b979-75af2dc0b366 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:57.416662 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-aeb258ff-5097-4646-b979-75af2dc0b366 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:57.426459 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aeb258ff-5097-4646-b979-75af2dc0b366 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:57.426910 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aeb258ff-5097-4646-b979-75af2dc0b366 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:57.427803 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aeb258ff-5097-4646-b979-75af2dc0b366 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:57.428238 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-aeb258ff-5097-4646-b979-75af2dc0b366 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:57.444837 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cc476887-ea48-4b24-af92-47711fb123f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:57.453765 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-cc476887-ea48-4b24-af92-47711fb123f5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1724 microversion: 2.1 time: 0.232661 Jun 16 16:17:57.454564 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 305/620] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:57 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:57.608246 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-aeb258ff-5097-4646-b979-75af2dc0b366 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:57.618653 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-aeb258ff-5097-4646-b979-75af2dc0b366 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1512 microversion: 2.1 time: 0.212855 Jun 16 16:17:57.619233 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 316/621] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:57 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1512 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:58.479212 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-74b0f02a-ddea-4ad4-aba9-903f14654d50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:58.480040 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-74b0f02a-ddea-4ad4-aba9-903f14654d50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:58.488419 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74b0f02a-ddea-4ad4-aba9-903f14654d50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:58.489016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74b0f02a-ddea-4ad4-aba9-903f14654d50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:58.497586 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74b0f02a-ddea-4ad4-aba9-903f14654d50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:58.497586 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74b0f02a-ddea-4ad4-aba9-903f14654d50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:58.637054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-9b0d20df-2561-485c-a13e-346dcac8540d tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:58.638044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-9b0d20df-2561-485c-a13e-346dcac8540d tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:58.646129 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9b0d20df-2561-485c-a13e-346dcac8540d tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:58.646920 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9b0d20df-2561-485c-a13e-346dcac8540d tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:58.647723 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9b0d20df-2561-485c-a13e-346dcac8540d tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:58.648181 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9b0d20df-2561-485c-a13e-346dcac8540d tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:58.673434 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-74b0f02a-ddea-4ad4-aba9-903f14654d50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:58.685740 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-74b0f02a-ddea-4ad4-aba9-903f14654d50 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1724 microversion: 2.1 time: 0.214369 Jun 16 16:17:58.686408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 306/622] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:58 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:58.839857 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-9b0d20df-2561-485c-a13e-346dcac8540d tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:58.850655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-9b0d20df-2561-485c-a13e-346dcac8540d tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1512 microversion: 2.1 time: 0.217938 Jun 16 16:17:58.851502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 317/623] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:58 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:59.711872 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9431819c-813e-41b1-b346-d45505f0bbcd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:59.712570 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9431819c-813e-41b1-b346-d45505f0bbcd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:59.723490 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9431819c-813e-41b1-b346-d45505f0bbcd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:59.724291 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9431819c-813e-41b1-b346-d45505f0bbcd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:59.725448 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9431819c-813e-41b1-b346-d45505f0bbcd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:59.725945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9431819c-813e-41b1-b346-d45505f0bbcd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:59.876013 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6c06f04a-cd62-42a5-8833-71febde75079 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:59.876744 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6c06f04a-cd62-42a5-8833-71febde75079 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:59.884806 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6c06f04a-cd62-42a5-8833-71febde75079 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:59.885262 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6c06f04a-cd62-42a5-8833-71febde75079 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:59.886144 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6c06f04a-cd62-42a5-8833-71febde75079 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:59.886641 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6c06f04a-cd62-42a5-8833-71febde75079 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:59.927612 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9431819c-813e-41b1-b346-d45505f0bbcd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:59.937136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9431819c-813e-41b1-b346-d45505f0bbcd tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1724 microversion: 2.1 time: 0.232810 Jun 16 16:17:59.937746 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 307/624] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:59 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:00.056652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6c06f04a-cd62-42a5-8833-71febde75079 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:00.067261 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6c06f04a-cd62-42a5-8833-71febde75079 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1512 microversion: 2.1 time: 0.195673 Jun 16 16:18:00.067893 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 318/625] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:59 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:00.960965 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9a5568e9-184d-4da0-8951-b71229560052 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:00.962085 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9a5568e9-184d-4da0-8951-b71229560052 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:00.972657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9a5568e9-184d-4da0-8951-b71229560052 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:00.973417 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9a5568e9-184d-4da0-8951-b71229560052 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:00.974859 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9a5568e9-184d-4da0-8951-b71229560052 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:00.975580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9a5568e9-184d-4da0-8951-b71229560052 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:01.002386 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:01.086446 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8f23f674-8c70-4f54-b976-030f0c9c2b24 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:01.087486 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8f23f674-8c70-4f54-b976-030f0c9c2b24 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:01.098194 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f23f674-8c70-4f54-b976-030f0c9c2b24 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:01.098669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f23f674-8c70-4f54-b976-030f0c9c2b24 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:01.099870 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f23f674-8c70-4f54-b976-030f0c9c2b24 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:01.100638 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f23f674-8c70-4f54-b976-030f0c9c2b24 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:01.177183 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9a5568e9-184d-4da0-8951-b71229560052 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:01.193106 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9a5568e9-184d-4da0-8951-b71229560052 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1724 microversion: 2.1 time: 0.239359 Jun 16 16:18:01.194225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 308/626] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:00 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:01.292057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8f23f674-8c70-4f54-b976-030f0c9c2b24 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:01.304359 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8f23f674-8c70-4f54-b976-030f0c9c2b24 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1512 microversion: 2.1 time: 0.223672 Jun 16 16:18:01.305163 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 319/627] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:01 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1512 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:02.213536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8a71ab56-cc16-44f3-9d0a-f24938ccfeca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:02.214231 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8a71ab56-cc16-44f3-9d0a-f24938ccfeca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:02.223992 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a71ab56-cc16-44f3-9d0a-f24938ccfeca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:02.224790 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a71ab56-cc16-44f3-9d0a-f24938ccfeca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:02.225711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a71ab56-cc16-44f3-9d0a-f24938ccfeca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:02.226193 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8a71ab56-cc16-44f3-9d0a-f24938ccfeca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:02.331062 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ca2c8b8e-61f9-403c-8d0d-53b4c1a3565e tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:02.332060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ca2c8b8e-61f9-403c-8d0d-53b4c1a3565e tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:02.340330 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ca2c8b8e-61f9-403c-8d0d-53b4c1a3565e tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:02.340783 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ca2c8b8e-61f9-403c-8d0d-53b4c1a3565e tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:02.354909 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ca2c8b8e-61f9-403c-8d0d-53b4c1a3565e tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:02.355412 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ca2c8b8e-61f9-403c-8d0d-53b4c1a3565e tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:02.560624 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ca2c8b8e-61f9-403c-8d0d-53b4c1a3565e tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:02.564031 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8a71ab56-cc16-44f3-9d0a-f24938ccfeca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:02.576363 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8a71ab56-cc16-44f3-9d0a-f24938ccfeca tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1730 microversion: 2.1 time: 0.366744 Jun 16 16:18:02.576788 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ca2c8b8e-61f9-403c-8d0d-53b4c1a3565e tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 200 len: 1512 microversion: 2.1 time: 0.249961 Jun 16 16:18:02.578425 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 320/628] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:02 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:02.592834 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 309/629] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:02 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1730 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:02.608443 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-43973d36-0b67-41be-bdfe-a8cc4be09489 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:02.608443 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-43973d36-0b67-41be-bdfe-a8cc4be09489 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:02.619219 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43973d36-0b67-41be-bdfe-a8cc4be09489 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:02.619954 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43973d36-0b67-41be-bdfe-a8cc4be09489 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:02.621182 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43973d36-0b67-41be-bdfe-a8cc4be09489 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:02.621713 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43973d36-0b67-41be-bdfe-a8cc4be09489 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:02.679362 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-17cf704b-cf2d-4213-b25e-53837a7b45e8 req-fafcc84c-37a2-4f2a-bb0b-cd351e3b8591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92f12382-4577-4486-99ea-ddc9f6e43e37", "name": "network-vif-deleted", "tag": "2c30997e-910b-45d6-b451-86b997261a88"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:02.693209 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-17cf704b-cf2d-4213-b25e-53837a7b45e8 req-fafcc84c-37a2-4f2a-bb0b-cd351e3b8591 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:02.693914 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-17cf704b-cf2d-4213-b25e-53837a7b45e8 req-fafcc84c-37a2-4f2a-bb0b-cd351e3b8591 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:02.727719 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-17cf704b-cf2d-4213-b25e-53837a7b45e8 req-fafcc84c-37a2-4f2a-bb0b-cd351e3b8591 service nova] Creating event network-vif-deleted:2c30997e-910b-45d6-b451-86b997261a88 for instance 92f12382-4577-4486-99ea-ddc9f6e43e37 on hv-cinder-83716 Jun 16 16:18:02.741629 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-17cf704b-cf2d-4213-b25e-53837a7b45e8 req-fafcc84c-37a2-4f2a-bb0b-cd351e3b8591 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145924 Jun 16 16:18:02.742636 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 321/630] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:02.748518 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-43973d36-0b67-41be-bdfe-a8cc4be09489 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148669 Jun 16 16:18:02.749188 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 310/631] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 16:18:02 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:03.606360 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-59e31316-7a98-40a6-9b1d-70e258aac036 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:03.607563 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-59e31316-7a98-40a6-9b1d-70e258aac036 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 92f12382-4577-4486-99ea-ddc9f6e43e37] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:03.610814 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:03.621435 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-59e31316-7a98-40a6-9b1d-70e258aac036 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:03.622222 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-59e31316-7a98-40a6-9b1d-70e258aac036 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:03.623546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-59e31316-7a98-40a6-9b1d-70e258aac036 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:03.624313 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-59e31316-7a98-40a6-9b1d-70e258aac036 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:03.648206 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-59e31316-7a98-40a6-9b1d-70e258aac036 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] HTTP exception thrown: Instance 92f12382-4577-4486-99ea-ddc9f6e43e37 could not be found. Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-59e31316-7a98-40a6-9b1d-70e258aac036 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Request method failure captured: Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 HTTP/1.1 Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1dzaQfK2IeIvhC5pryi0sFoDpsZtCBDniyHsqexdq0rJL4iWsKpxVirVkXvv5sg0bfdbIkdenyNONAsABU9S7FOOZ9J1Pf9kTcx9sSx_HkNj4kdcCNfrkLbvug6mEb1AdEtQLRHKepJIDCBZvsxQ5pMJBLUlgnwTsGlvmgq_VzoZbQ Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: cb4bbded2b5a4d5fa7760540cfa123f7 Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1621764165 Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:18:03.651402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:18:03.652991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cb4bbded2b5a4d5fa7760540cfa123f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb4bbded2b5a4d5fa7760540cfa123f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cb4bbded2b5a4d5fa7760540cfa123f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb4bbded2b5a4d5fa7760540cfa123f7"}]}] Jun 16 16:18:03.652991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-VolumesSnapshotTestJSON-1621764165 Jun 16 16:18:03.652991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: cb4bbded2b5a4d5fa7760540cfa123f7 Jun 16 16:18:03.652991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1621764165 Jun 16 16:18:03.652991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-VolumesSnapshotTestJSON-1621764165-project Jun 16 16:18:03.652991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:18:03.652991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:18:03.652991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: ff118e281f40435d8a8253ad10a9042f Jun 16 16:18:03.652991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-VolumesSnapshotTestJSON-1621764165-project Jun 16 16:18:03.652991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:18:03.652991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance 92f12382-4577-4486-99ea-ddc9f6e43e37 could not be found. Jun 16 16:18:03.652991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': '92f12382-4577-4486-99ea-ddc9f6e43e37'} Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92f12382-4577-4486-99ea-ddc9f6e43e37 could not be found. Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:18:03.653883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92f12382-4577-4486-99ea-ddc9f6e43e37 could not be found. Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92f12382-4577-4486-99ea-ddc9f6e43e37 could not be found. Jun 16 16:18:03.655320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:03.656458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-59e31316-7a98-40a6-9b1d-70e258aac036 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Returning 404 to user: Instance 92f12382-4577-4486-99ea-ddc9f6e43e37 could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:18:03.656458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-59e31316-7a98-40a6-9b1d-70e258aac036 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37" status: 404 len: 111 microversion: 2.1 time: 0.055942 Jun 16 16:18:03.656458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 322/632] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:03 2022] GET /compute/v2.1/servers/92f12382-4577-4486-99ea-ddc9f6e43e37 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:18:04.761887 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-84895450-a572-448d-beee-ddb1b034bfd8 req-722a7c8d-dbb7-49b9-ab5f-927884e9d375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a915f676-f877-4b53-9061-2b6d5216e40f", "tag": "3a209b58-0eab-4734-8530-5197ed6024ff"}, {"name": "network-changed", "server_uuid": "a915f676-f877-4b53-9061-2b6d5216e40f", "tag": "3a209b58-0eab-4734-8530-5197ed6024ff"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:04.765960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=34 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:04.772968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-84895450-a572-448d-beee-ddb1b034bfd8 req-722a7c8d-dbb7-49b9-ab5f-927884e9d375 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:04.773326 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-84895450-a572-448d-beee-ddb1b034bfd8 req-722a7c8d-dbb7-49b9-ab5f-927884e9d375 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:04.786975 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-84895450-a572-448d-beee-ddb1b034bfd8 req-722a7c8d-dbb7-49b9-ab5f-927884e9d375 service nova] Creating event network-changed:3a209b58-0eab-4734-8530-5197ed6024ff for instance a915f676-f877-4b53-9061-2b6d5216e40f on hv-cinder-83716 Jun 16 16:18:04.787494 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-84895450-a572-448d-beee-ddb1b034bfd8 req-722a7c8d-dbb7-49b9-ab5f-927884e9d375 service nova] Creating event network-changed:3a209b58-0eab-4734-8530-5197ed6024ff for instance a915f676-f877-4b53-9061-2b6d5216e40f on hv-cinder-83716 Jun 16 16:18:04.795285 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-84895450-a572-448d-beee-ddb1b034bfd8 req-722a7c8d-dbb7-49b9-ab5f-927884e9d375 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037473 Jun 16 16:18:04.796393 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 311/633] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:10.953650 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-73251bc9-a2e1-4658-a994-d94da07bcb8c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:10.954496 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-73251bc9-a2e1-4658-a994-d94da07bcb8c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:10.962093 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-73251bc9-a2e1-4658-a994-d94da07bcb8c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:10.962565 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-73251bc9-a2e1-4658-a994-d94da07bcb8c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:10.963347 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-73251bc9-a2e1-4658-a994-d94da07bcb8c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:10.963835 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-73251bc9-a2e1-4658-a994-d94da07bcb8c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:10.989755 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-73251bc9-a2e1-4658-a994-d94da07bcb8c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe/ips" status: 200 len: 149 microversion: 2.1 time: 0.039977 Jun 16 16:18:10.990381 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 323/634] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 16:18:10 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:11.719239 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1325804787", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "networks": [{"uuid": "f7d4ecdc-bb0f-456d-aa92-24e4392aa63f"}]}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:11.782107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] validate_networks() for [('f7d4ecdc-bb0f-456d-aa92-24e4392aa63f', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:18:12.307818 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:18:12.308350 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:18:12.308921 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:18:12.309352 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:18:12.309808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:18:12.320768 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:12.321242 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:12.322178 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:12.322767 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:12.344956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Getting quotas for project cb4bbded2b5a4d5fa7760540cfa123f7. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:18:12.353498 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Getting quotas for user ff118e281f40435d8a8253ad10a9042f and project cb4bbded2b5a4d5fa7760540cfa123f7. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:18:12.379231 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:18:12.384044 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:18:12.430453 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b62e6a37-9bf1-4682-9a50-41b08fc06a81 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ace4af25-2904-4c99-a622-6017cdd6ffee"}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:12.431512 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b62e6a37-9bf1-4682-9a50-41b08fc06a81 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:12.441394 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b62e6a37-9bf1-4682-9a50-41b08fc06a81 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:12.442102 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b62e6a37-9bf1-4682-9a50-41b08fc06a81 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:12.443140 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b62e6a37-9bf1-4682-9a50-41b08fc06a81 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:12.443855 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b62e6a37-9bf1-4682-9a50-41b08fc06a81 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:12.450378 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b1d1f8e1-cbb2-4773-bae9-2e1445584bbb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740743 Jun 16 16:18:12.451440 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 312/635] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:18:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:18:12.463289 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-84a46969-dbe0-471e-8cba-b5318d9df388 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:12.464285 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-84a46969-dbe0-471e-8cba-b5318d9df388 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:12.557512 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-84a46969-dbe0-471e-8cba-b5318d9df388 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:12.566359 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-84a46969-dbe0-471e-8cba-b5318d9df388 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1219 microversion: 2.1 time: 0.107356 Jun 16 16:18:12.567163 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 313/636] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:12 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:12.813917 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b62e6a37-9bf1-4682-9a50-41b08fc06a81 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "POST /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387486 Jun 16 16:18:12.820227 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 324/637] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 16:18:12 2022] POST /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:18:13.588845 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0e23028e-b957-4528-9469-b1e123117f95 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:13.589810 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0e23028e-b957-4528-9469-b1e123117f95 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:13.600861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e23028e-b957-4528-9469-b1e123117f95 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:13.601398 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e23028e-b957-4528-9469-b1e123117f95 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:13.605837 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e23028e-b957-4528-9469-b1e123117f95 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:13.605837 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0e23028e-b957-4528-9469-b1e123117f95 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:13.686592 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0e23028e-b957-4528-9469-b1e123117f95 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:13.700245 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0e23028e-b957-4528-9469-b1e123117f95 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1271 microversion: 2.1 time: 0.118598 Jun 16 16:18:13.700833 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 314/638] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:13 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:14.719937 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-751d8cd3-1193-4113-bae4-825bf5bbb5a8 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:14.720634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-751d8cd3-1193-4113-bae4-825bf5bbb5a8 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:14.728094 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-751d8cd3-1193-4113-bae4-825bf5bbb5a8 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:14.728553 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-751d8cd3-1193-4113-bae4-825bf5bbb5a8 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:14.729362 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-751d8cd3-1193-4113-bae4-825bf5bbb5a8 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:14.729808 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-751d8cd3-1193-4113-bae4-825bf5bbb5a8 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:14.751332 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:14.814374 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-751d8cd3-1193-4113-bae4-825bf5bbb5a8 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:14.828284 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-751d8cd3-1193-4113-bae4-825bf5bbb5a8 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1279 microversion: 2.1 time: 0.112845 Jun 16 16:18:14.828284 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 325/639] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:14 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1279 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:15.194386 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-59870e77-b278-4007-8999-a9d0cbe5d94d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ace4af25-2904-4c99-a622-6017cdd6ffee"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:15.196070 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-59870e77-b278-4007-8999-a9d0cbe5d94d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:15.207998 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59870e77-b278-4007-8999-a9d0cbe5d94d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:15.208747 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59870e77-b278-4007-8999-a9d0cbe5d94d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:15.210064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59870e77-b278-4007-8999-a9d0cbe5d94d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:15.210891 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59870e77-b278-4007-8999-a9d0cbe5d94d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:15.339982 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-59870e77-b278-4007-8999-a9d0cbe5d94d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] HTTP exception thrown: Invalid volume: volume ace4af25-2904-4c99-a622-6017cdd6ffee is already attached to instances: e2e89e07-513d-41ba-982f-b29bbc494ffe Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-59870e77-b278-4007-8999-a9d0cbe5d94d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Request method failure captured: Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: POST /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe/os-volume_attachments HTTP/1.1 Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 74 Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ZUq1kgzW_sDLNXIMMrLIuaVIQDyIYyD_QFPpTquNy4hAl_e3YmJtCQ9vDG5Gi9dl3M7alwHb45g-Cko2VZfCdciDPJaW1quIm5ySkHotQHkgN6wNvH9ZeEMkPp9RFHfNBz6m-xTNRiXVTSKnJGaGWLNz7_WuUCsTsM3KjkFbV_vCQ Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:18:15.343559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:18:15.346538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}] Jun 16 16:18:15.346538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:18:15.346538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:18:15.346538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:18:15.346538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:18:15.346538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:18:15.346538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:18:15.346538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 2c34f05634d34da29088bcf75069958d Jun 16 16:18:15.346538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:18:15.346538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Jun 16 16:18:15.346538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {"volumeAttachment": {"volumeId": "ace4af25-2904-4c99-a622-6017cdd6ffee"}} Jun 16 16:18:15.346538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Invalid volume: volume ace4af25-2904-4c99-a622-6017cdd6ffee is already attached to instances: e2e89e07-513d-41ba-982f-b29bbc494ffe Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'server_id': 'e2e89e07-513d-41ba-982f-b29bbc494ffe', 'body': {'volumeAttachment': {'volumeId': 'ace4af25-2904-4c99-a622-6017cdd6ffee'}}} Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ace4af25-2904-4c99-a622-6017cdd6ffee is already attached to instances: e2e89e07-513d-41ba-982f-b29bbc494ffe Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:18:15.348210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ace4af25-2904-4c99-a622-6017cdd6ffee is already attached to instances: e2e89e07-513d-41ba-982f-b29bbc494ffe Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:15.350906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:18:15.353571 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:18:15.353571 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:18:15.353571 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:18:15.353571 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ace4af25-2904-4c99-a622-6017cdd6ffee is already attached to instances: e2e89e07-513d-41ba-982f-b29bbc494ffe Jun 16 16:18:15.353571 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:18:15.356075 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-59870e77-b278-4007-8999-a9d0cbe5d94d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Returning 400 to user: Invalid volume: volume ace4af25-2904-4c99-a622-6017cdd6ffee is already attached to instances: e2e89e07-513d-41ba-982f-b29bbc494ffe {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:18:15.357584 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-59870e77-b278-4007-8999-a9d0cbe5d94d tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "POST /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.168630 Jun 16 16:18:15.358656 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 315/640] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 16:18:15 2022] POST /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe/os-volume_attachments => generated 174 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:18:15.431026 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e6d9dcf7-28d2-4a4b-8b1f-31c6ffb84a5b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:15.431505 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e6d9dcf7-28d2-4a4b-8b1f-31c6ffb84a5b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:15.438840 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e6d9dcf7-28d2-4a4b-8b1f-31c6ffb84a5b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:15.439419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e6d9dcf7-28d2-4a4b-8b1f-31c6ffb84a5b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:15.441255 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e6d9dcf7-28d2-4a4b-8b1f-31c6ffb84a5b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:15.442222 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e6d9dcf7-28d2-4a4b-8b1f-31c6ffb84a5b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:15.555525 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-e6d9dcf7-28d2-4a4b-8b1f-31c6ffb84a5b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lazy-loading 'services' on Instance uuid e2e89e07-513d-41ba-982f-b29bbc494ffe {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:18:15.651361 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e6d9dcf7-28d2-4a4b-8b1f-31c6ffb84a5b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe/os-volume_attachments/ace4af25-2904-4c99-a622-6017cdd6ffee" status: 202 len: 0 microversion: 2.1 time: 0.223796 Jun 16 16:18:15.654331 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 326/641] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 16:18:15 2022] DELETE /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe/os-volume_attachments/ace4af25-2904-4c99-a622-6017cdd6ffee => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:18:15.662500 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-43bad81a-953a-4c8a-b35a-21a6dceee24c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:15.663371 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-43bad81a-953a-4c8a-b35a-21a6dceee24c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:15.673651 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43bad81a-953a-4c8a-b35a-21a6dceee24c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:15.674870 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43bad81a-953a-4c8a-b35a-21a6dceee24c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:15.676407 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43bad81a-953a-4c8a-b35a-21a6dceee24c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:15.677034 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-43bad81a-953a-4c8a-b35a-21a6dceee24c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:15.730366 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-43bad81a-953a-4c8a-b35a-21a6dceee24c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072948 Jun 16 16:18:15.731067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 316/642] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:18:15 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:15.846789 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8a14372f-5c54-4460-a3c2-c9831fec1387 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:15.848562 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8a14372f-5c54-4460-a3c2-c9831fec1387 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:15.859226 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8a14372f-5c54-4460-a3c2-c9831fec1387 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:15.859856 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8a14372f-5c54-4460-a3c2-c9831fec1387 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:15.861114 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8a14372f-5c54-4460-a3c2-c9831fec1387 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:15.863366 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8a14372f-5c54-4460-a3c2-c9831fec1387 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:16.055264 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8a14372f-5c54-4460-a3c2-c9831fec1387 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:16.063540 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8a14372f-5c54-4460-a3c2-c9831fec1387 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1319 microversion: 2.1 time: 0.222005 Jun 16 16:18:16.064205 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 327/643] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:15 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:16.488983 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-de958015-e4df-4de4-a22d-695de6651d7a req-fc5c9eab-6ebf-4fc2-8848-0da189743c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dcb1996-2963-4d45-bf74-e753c4ad9eee", "tag": "024b92d2-158e-4a6e-bef1-45ef59b811b6"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:16.504633 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-de958015-e4df-4de4-a22d-695de6651d7a req-fc5c9eab-6ebf-4fc2-8848-0da189743c66 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:16.505711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-de958015-e4df-4de4-a22d-695de6651d7a req-fc5c9eab-6ebf-4fc2-8848-0da189743c66 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:16.526696 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-de958015-e4df-4de4-a22d-695de6651d7a req-fc5c9eab-6ebf-4fc2-8848-0da189743c66 service nova] Creating event network-changed:024b92d2-158e-4a6e-bef1-45ef59b811b6 for instance 3dcb1996-2963-4d45-bf74-e753c4ad9eee on hv-cinder-83716 Jun 16 16:18:16.536548 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-de958015-e4df-4de4-a22d-695de6651d7a req-fc5c9eab-6ebf-4fc2-8848-0da189743c66 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055115 Jun 16 16:18:16.537493 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 317/644] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:16.744353 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-12a5990b-6f9d-4351-bd03-ed2982bfc4fe tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:16.746067 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-12a5990b-6f9d-4351-bd03-ed2982bfc4fe tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:16.755651 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-12a5990b-6f9d-4351-bd03-ed2982bfc4fe tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:16.756245 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-12a5990b-6f9d-4351-bd03-ed2982bfc4fe tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:16.757403 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-12a5990b-6f9d-4351-bd03-ed2982bfc4fe tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:16.758086 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-12a5990b-6f9d-4351-bd03-ed2982bfc4fe tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:16.808230 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-12a5990b-6f9d-4351-bd03-ed2982bfc4fe tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069543 Jun 16 16:18:16.808835 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 328/645] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:18:16 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:18:16.882188 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0db15ebf-1242-48b1-b8ef-3a66455d8960 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:16.883818 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0db15ebf-1242-48b1-b8ef-3a66455d8960 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:16.891303 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0db15ebf-1242-48b1-b8ef-3a66455d8960 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:16.891851 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0db15ebf-1242-48b1-b8ef-3a66455d8960 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:16.893672 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0db15ebf-1242-48b1-b8ef-3a66455d8960 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:16.894562 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0db15ebf-1242-48b1-b8ef-3a66455d8960 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:16.926096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0db15ebf-1242-48b1-b8ef-3a66455d8960 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:18:17.034276 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0db15ebf-1242-48b1-b8ef-3a66455d8960 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 204 len: 0 microversion: 2.1 time: 0.159533 Jun 16 16:18:17.035189 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 318/646] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:18:16 2022] DELETE /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:18:17.053215 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f4bc9d02-b60e-4aed-8fd4-0a79d790054b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:17.054485 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f4bc9d02-b60e-4aed-8fd4-0a79d790054b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:17.068952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f4bc9d02-b60e-4aed-8fd4-0a79d790054b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:17.069648 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f4bc9d02-b60e-4aed-8fd4-0a79d790054b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:17.071055 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f4bc9d02-b60e-4aed-8fd4-0a79d790054b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:17.071721 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f4bc9d02-b60e-4aed-8fd4-0a79d790054b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:17.084591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2ebb5abf-9261-477f-839a-9218dda074d5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:17.085314 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2ebb5abf-9261-477f-839a-9218dda074d5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:17.093536 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ebb5abf-9261-477f-839a-9218dda074d5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:17.094943 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ebb5abf-9261-477f-839a-9218dda074d5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:17.095758 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ebb5abf-9261-477f-839a-9218dda074d5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:17.096205 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2ebb5abf-9261-477f-839a-9218dda074d5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:17.251072 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f4bc9d02-b60e-4aed-8fd4-0a79d790054b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:17.261441 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f4bc9d02-b60e-4aed-8fd4-0a79d790054b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1681 microversion: 2.1 time: 0.218891 Jun 16 16:18:17.262332 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 329/647] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:17 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:17.276558 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2ebb5abf-9261-477f-839a-9218dda074d5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:17.286016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2ebb5abf-9261-477f-839a-9218dda074d5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1319 microversion: 2.1 time: 0.206175 Jun 16 16:18:17.286629 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 319/648] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:17 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:18.280923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-82a86296-84d4-49c5-8e36-08cddb5e769c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:18.281550 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-82a86296-84d4-49c5-8e36-08cddb5e769c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:18.290319 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-82a86296-84d4-49c5-8e36-08cddb5e769c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:18.290864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-82a86296-84d4-49c5-8e36-08cddb5e769c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:18.291661 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-82a86296-84d4-49c5-8e36-08cddb5e769c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:18.292103 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-82a86296-84d4-49c5-8e36-08cddb5e769c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:18.307616 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-71e5ae4b-e88e-4dbc-bfef-07ef8b7caf46 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:18.308480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-71e5ae4b-e88e-4dbc-bfef-07ef8b7caf46 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:18.315965 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-71e5ae4b-e88e-4dbc-bfef-07ef8b7caf46 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:18.316502 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-71e5ae4b-e88e-4dbc-bfef-07ef8b7caf46 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:18.317300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-71e5ae4b-e88e-4dbc-bfef-07ef8b7caf46 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:18.317769 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-71e5ae4b-e88e-4dbc-bfef-07ef8b7caf46 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:18.481689 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-82a86296-84d4-49c5-8e36-08cddb5e769c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:18.493724 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-82a86296-84d4-49c5-8e36-08cddb5e769c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1681 microversion: 2.1 time: 0.216420 Jun 16 16:18:18.494755 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 330/649] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:18 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:18.512967 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-71e5ae4b-e88e-4dbc-bfef-07ef8b7caf46 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:18.527334 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-71e5ae4b-e88e-4dbc-bfef-07ef8b7caf46 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1319 microversion: 2.1 time: 0.224516 Jun 16 16:18:18.527929 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 320/650] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:18 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:19.518521 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e68c7096-11d2-42c0-a43a-348dad471651 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:19.519757 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e68c7096-11d2-42c0-a43a-348dad471651 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:19.528924 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e68c7096-11d2-42c0-a43a-348dad471651 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:19.529390 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e68c7096-11d2-42c0-a43a-348dad471651 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:19.530222 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e68c7096-11d2-42c0-a43a-348dad471651 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:19.530665 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e68c7096-11d2-42c0-a43a-348dad471651 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:19.547711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3e696635-bdd5-443b-99c2-e3ddcf477703 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:19.548320 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3e696635-bdd5-443b-99c2-e3ddcf477703 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:19.555538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e696635-bdd5-443b-99c2-e3ddcf477703 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:19.555977 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e696635-bdd5-443b-99c2-e3ddcf477703 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:19.556743 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e696635-bdd5-443b-99c2-e3ddcf477703 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:19.557171 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3e696635-bdd5-443b-99c2-e3ddcf477703 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:19.714733 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e68c7096-11d2-42c0-a43a-348dad471651 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:19.728047 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e68c7096-11d2-42c0-a43a-348dad471651 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1681 microversion: 2.1 time: 0.213979 Jun 16 16:18:19.728878 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 331/651] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:19 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:19.739826 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3e696635-bdd5-443b-99c2-e3ddcf477703 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:19.748812 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3e696635-bdd5-443b-99c2-e3ddcf477703 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1319 microversion: 2.1 time: 0.204025 Jun 16 16:18:19.759524 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 321/652] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:19 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:20.747408 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-50df8eea-3eb4-4ec1-a4d7-6eecb42ba231 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:20.748584 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-50df8eea-3eb4-4ec1-a4d7-6eecb42ba231 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:20.757263 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-50df8eea-3eb4-4ec1-a4d7-6eecb42ba231 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:20.757849 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-50df8eea-3eb4-4ec1-a4d7-6eecb42ba231 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:20.759580 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-50df8eea-3eb4-4ec1-a4d7-6eecb42ba231 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:20.759580 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-50df8eea-3eb4-4ec1-a4d7-6eecb42ba231 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:20.803458 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3f6c7467-cf45-446d-a688-a23163f97272 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:20.803458 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3f6c7467-cf45-446d-a688-a23163f97272 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:20.813609 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f6c7467-cf45-446d-a688-a23163f97272 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:20.814496 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f6c7467-cf45-446d-a688-a23163f97272 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:20.816721 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f6c7467-cf45-446d-a688-a23163f97272 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:20.817306 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f6c7467-cf45-446d-a688-a23163f97272 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:21.008911 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3f6c7467-cf45-446d-a688-a23163f97272 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:21.021840 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3f6c7467-cf45-446d-a688-a23163f97272 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1319 microversion: 2.1 time: 0.245025 Jun 16 16:18:21.023447 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 322/653] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:20 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:21.037748 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-50df8eea-3eb4-4ec1-a4d7-6eecb42ba231 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:21.050126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-50df8eea-3eb4-4ec1-a4d7-6eecb42ba231 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1681 microversion: 2.1 time: 0.307255 Jun 16 16:18:21.051133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 332/654] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:20 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1681 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:21.700116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-56a81193-1178-4cf0-ae3e-67446fa159d2 req-05bef88f-6256-4a8a-8f7f-11c2fdc274ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e89e07-513d-41ba-982f-b29bbc494ffe", "name": "network-vif-deleted", "tag": "de23705d-f0e2-4a20-bc77-f99d6d881c5c"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:21.717560 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-56a81193-1178-4cf0-ae3e-67446fa159d2 req-05bef88f-6256-4a8a-8f7f-11c2fdc274ac service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:21.718749 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-56a81193-1178-4cf0-ae3e-67446fa159d2 req-05bef88f-6256-4a8a-8f7f-11c2fdc274ac service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:21.750485 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-56a81193-1178-4cf0-ae3e-67446fa159d2 req-05bef88f-6256-4a8a-8f7f-11c2fdc274ac service nova] Creating event network-vif-deleted:de23705d-f0e2-4a20-bc77-f99d6d881c5c for instance e2e89e07-513d-41ba-982f-b29bbc494ffe on hv-cinder-83716 Jun 16 16:18:21.756939 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-56a81193-1178-4cf0-ae3e-67446fa159d2 req-05bef88f-6256-4a8a-8f7f-11c2fdc274ac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164083 Jun 16 16:18:21.760937 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 323/655] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:22.043091 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-86523f43-f51d-45bf-b893-a56d97285604 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:22.044123 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-86523f43-f51d-45bf-b893-a56d97285604 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:22.056952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-86523f43-f51d-45bf-b893-a56d97285604 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:22.057776 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-86523f43-f51d-45bf-b893-a56d97285604 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:22.059036 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-86523f43-f51d-45bf-b893-a56d97285604 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:22.059743 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-86523f43-f51d-45bf-b893-a56d97285604 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:22.070472 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3a86d609-a551-4094-be31-bfe4da72b5a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:22.071993 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3a86d609-a551-4094-be31-bfe4da72b5a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:22.081986 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3a86d609-a551-4094-be31-bfe4da72b5a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:22.082548 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3a86d609-a551-4094-be31-bfe4da72b5a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:22.083695 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3a86d609-a551-4094-be31-bfe4da72b5a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:22.084215 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3a86d609-a551-4094-be31-bfe4da72b5a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:22.124331 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3a86d609-a551-4094-be31-bfe4da72b5a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:22.124940 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3a86d609-a551-4094-be31-bfe4da72b5a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:22.125521 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-3a86d609-a551-4094-be31-bfe4da72b5a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lazy-loading 'fault' on Instance uuid e2e89e07-513d-41ba-982f-b29bbc494ffe {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:18:22.194240 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3a86d609-a551-4094-be31-bfe4da72b5a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:22.203825 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3a86d609-a551-4094-be31-bfe4da72b5a0 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 200 len: 1331 microversion: 2.1 time: 0.138737 Jun 16 16:18:22.224355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 324/656] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:22 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 1331 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:22.395369 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-86523f43-f51d-45bf-b893-a56d97285604 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:22.405159 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-86523f43-f51d-45bf-b893-a56d97285604 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1319 microversion: 2.1 time: 0.367738 Jun 16 16:18:22.407190 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 333/657] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:22 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:22.503876 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=2 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:22.562960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=8 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:22.615017 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-860cfc06-6eeb-40a5-a1ab-b41ca5314d94 req-a14469bb-832b-4aa5-80b5-fceb207493c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dcb1996-2963-4d45-bf74-e753c4ad9eee", "name": "network-vif-plugged", "status": "completed", "tag": "024b92d2-158e-4a6e-bef1-45ef59b811b6"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:22.624079 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-860cfc06-6eeb-40a5-a1ab-b41ca5314d94 req-a14469bb-832b-4aa5-80b5-fceb207493c5 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:22.624650 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-860cfc06-6eeb-40a5-a1ab-b41ca5314d94 req-a14469bb-832b-4aa5-80b5-fceb207493c5 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:22.639441 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-860cfc06-6eeb-40a5-a1ab-b41ca5314d94 req-a14469bb-832b-4aa5-80b5-fceb207493c5 service nova] Creating event network-vif-plugged:024b92d2-158e-4a6e-bef1-45ef59b811b6 for instance 3dcb1996-2963-4d45-bf74-e753c4ad9eee on hv-cinder-83716 Jun 16 16:18:22.646069 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-860cfc06-6eeb-40a5-a1ab-b41ca5314d94 req-a14469bb-832b-4aa5-80b5-fceb207493c5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144564 Jun 16 16:18:22.646687 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 325/658] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:23.232035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-550929b0-290c-4b8f-bfcc-d55e2c423f6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:23.232837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-550929b0-290c-4b8f-bfcc-d55e2c423f6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:23.243939 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-550929b0-290c-4b8f-bfcc-d55e2c423f6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:23.244708 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-550929b0-290c-4b8f-bfcc-d55e2c423f6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:23.246599 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-550929b0-290c-4b8f-bfcc-d55e2c423f6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:23.246599 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-550929b0-290c-4b8f-bfcc-d55e2c423f6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:23.265010 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-550929b0-290c-4b8f-bfcc-d55e2c423f6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] HTTP exception thrown: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-550929b0-290c-4b8f-bfcc-d55e2c423f6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Request method failure captured: Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe HTTP/1.1 Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ZUq1kgzW_sDLNXIMMrLIuaVIQDyIYyD_QFPpTquNy4hAl_e3YmJtCQ9vDG5Gi9dl3M7alwHb45g-Cko2VZfCdciDPJaW1quIm5ySkHotQHkgN6wNvH9ZeEMkPp9RFHfNBz6m-xTNRiXVTSKnJGaGWLNz7_WuUCsTsM3KjkFbV_vCQ Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:18:23.266745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:18:23.269684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}] Jun 16 16:18:23.269684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:18:23.269684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:18:23.269684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:18:23.269684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:18:23.269684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:18:23.269684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:18:23.269684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 2c34f05634d34da29088bcf75069958d Jun 16 16:18:23.269684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:18:23.269684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:18:23.269684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. Jun 16 16:18:23.269684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': 'e2e89e07-513d-41ba-982f-b29bbc494ffe'} Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:18:23.270606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. Jun 16 16:18:23.272030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:23.273291 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-550929b0-290c-4b8f-bfcc-d55e2c423f6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Returning 404 to user: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:18:23.273291 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-550929b0-290c-4b8f-bfcc-d55e2c423f6c tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 404 len: 111 microversion: 2.1 time: 0.041673 Jun 16 16:18:23.273291 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 334/659] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:23 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:18:23.280162 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2e0349a6-0100-43f0-8e2b-84ae62bda5fb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '.version_select at 0x7f38bb5543a0>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:23.304609 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2e0349a6-0100-43f0-8e2b-84ae62bda5fb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-365075842" status: 202 len: 0 microversion: 2.1 time: 0.029032 Jun 16 16:18:23.305458 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 326/660] 10.222.0.17 () {58 vars in 1217 bytes} [Thu Jun 16 16:18:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-365075842 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:18:23.430808 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-21dd5116-7e3f-4343-a543-ca3012985cff tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:23.431618 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-21dd5116-7e3f-4343-a543-ca3012985cff tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:23.440685 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-21dd5116-7e3f-4343-a543-ca3012985cff tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:23.441363 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-21dd5116-7e3f-4343-a543-ca3012985cff tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:23.442527 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-21dd5116-7e3f-4343-a543-ca3012985cff tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:23.443093 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-21dd5116-7e3f-4343-a543-ca3012985cff tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:23.638544 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-21dd5116-7e3f-4343-a543-ca3012985cff tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:23.649957 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-21dd5116-7e3f-4343-a543-ca3012985cff tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1319 microversion: 2.1 time: 0.223775 Jun 16 16:18:23.650805 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 335/661] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:23 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:24.117648 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8acf145d-b4e8-4fc1-b9db-cc95ac2efacd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Action: 'create', calling method: .version_select at 0x7f38bb4bb3a0>, body: {"keypair": {"name": "tempest-keypair-392797866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQEizcG2e8va8vtN1HPWMgX6tIKQF+Gyx3y+jeN9B+27wP+0L2QZHLkKmUvpFVFpvE6QOQeVkkmS7v1yE1Q1YmqjdFSfrJOw7NyX42RyvE3bWlU5d5qJa/hebE7rF85Cg=="}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:24.141268 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-8acf145d-b4e8-4fc1-b9db-cc95ac2efacd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for project b091584c67814e4d8f7e88f0596880e3. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:18:24.146502 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-8acf145d-b4e8-4fc1-b9db-cc95ac2efacd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for user 2c34f05634d34da29088bcf75069958d and project b091584c67814e4d8f7e88f0596880e3. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:18:24.172136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8acf145d-b4e8-4fc1-b9db-cc95ac2efacd tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058784 Jun 16 16:18:24.172965 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 327/662] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 16:18:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:24.668628 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-510fa8f6-f7da-44ae-8ea8-37359cf84c1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:24.669786 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-510fa8f6-f7da-44ae-8ea8-37359cf84c1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:24.680747 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-510fa8f6-f7da-44ae-8ea8-37359cf84c1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:24.681507 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-510fa8f6-f7da-44ae-8ea8-37359cf84c1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:24.682582 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-510fa8f6-f7da-44ae-8ea8-37359cf84c1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:24.683087 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-510fa8f6-f7da-44ae-8ea8-37359cf84c1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:25.003141 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-510fa8f6-f7da-44ae-8ea8-37359cf84c1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:25.011836 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-510fa8f6-f7da-44ae-8ea8-37359cf84c1b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1508 microversion: 2.1 time: 0.347687 Jun 16 16:18:25.012471 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 336/663] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:24 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:25.031139 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-87f46eb7-794b-42a8-90cb-55945a54f7db tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bab4f74-d090-4ea0-81f3-db3de0f86612", "device": "/dev/sdb"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:25.034212 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-87f46eb7-794b-42a8-90cb-55945a54f7db tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:25.043016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-87f46eb7-794b-42a8-90cb-55945a54f7db tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:25.044007 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-87f46eb7-794b-42a8-90cb-55945a54f7db tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:25.045186 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-87f46eb7-794b-42a8-90cb-55945a54f7db tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:25.045982 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-87f46eb7-794b-42a8-90cb-55945a54f7db tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:25.456811 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:25.495668 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-87f46eb7-794b-42a8-90cb-55945a54f7db tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "POST /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.469946 Jun 16 16:18:25.496906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 328/664] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 16:18:25 2022] POST /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee/os-volume_attachments => generated 194 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:26.156067 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-01f38eef-fe46-4d58-b83d-da417cd6eb34 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-639997603"}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:26.156717 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-01f38eef-fe46-4d58-b83d-da417cd6eb34 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:26.170531 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-01f38eef-fe46-4d58-b83d-da417cd6eb34 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:26.171348 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-01f38eef-fe46-4d58-b83d-da417cd6eb34 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:26.172646 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-01f38eef-fe46-4d58-b83d-da417cd6eb34 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:26.173385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-01f38eef-fe46-4d58-b83d-da417cd6eb34 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:26.421956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1291261142", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cdb4f4d1-8b7f-401f-9aab-5045d67bace2"}], "security_groups": [{"name": "tempest-securitygroup--273008239"}], "key_name": "tempest-keypair-392797866", "user_data": "}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:26.432304 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.network.security_group_api [None req-01f38eef-fe46-4d58-b83d-da417cd6eb34 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Removing security group 14275c86-d82b-4e27-a8bf-f2c4b95be5fe from port 5082da5f-5306-4a23-b35d-d8a60373485c Jun 16 16:18:26.573084 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] validate_networks() for [('cdb4f4d1-8b7f-401f-9aab-5045d67bace2', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:18:26.934717 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-01f38eef-fe46-4d58-b83d-da417cd6eb34 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "POST /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/action" status: 202 len: 0 microversion: 2.1 time: 0.786180 Jun 16 16:18:26.935763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 337/665] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 16:18:26 2022] POST /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:18:26.953677 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-a754270c-753f-436f-8305-59788e242614 req-4a492856-c5d1-49c4-a37f-e05076eae62e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822d94ad-db52-4de9-8dfe-e3317ec09961", "tag": "5082da5f-5306-4a23-b35d-d8a60373485c"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:26.974782 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-a754270c-753f-436f-8305-59788e242614 req-4a492856-c5d1-49c4-a37f-e05076eae62e service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:26.985967 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-a754270c-753f-436f-8305-59788e242614 req-4a492856-c5d1-49c4-a37f-e05076eae62e service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:27.029202 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-a754270c-753f-436f-8305-59788e242614 req-4a492856-c5d1-49c4-a37f-e05076eae62e service nova] Creating event network-changed:5082da5f-5306-4a23-b35d-d8a60373485c for instance 822d94ad-db52-4de9-8dfe-e3317ec09961 on hv-cinder-83716 Jun 16 16:18:27.038975 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-a754270c-753f-436f-8305-59788e242614 req-4a492856-c5d1-49c4-a37f-e05076eae62e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091508 Jun 16 16:18:27.040535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 338/666] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:18:27.559854 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:18:27.561205 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:18:27.561961 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:18:27.562603 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:18:27.563409 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:18:27.576226 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:27.577012 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:27.579011 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:27.579210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:27.610073 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for project b091584c67814e4d8f7e88f0596880e3. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:18:27.618641 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Getting quotas for user 2c34f05634d34da29088bcf75069958d and project b091584c67814e4d8f7e88f0596880e3. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:18:27.634625 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:18:27.637518 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:18:27.699855 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e712c69c-9d1c-4576-be35-0d1ac5a49212 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.283878 Jun 16 16:18:27.700981 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 329/667] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:18:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:18:27.721288 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8b62b5db-e420-4c76-9154-a2eb21bae4a5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:27.722667 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8b62b5db-e420-4c76-9154-a2eb21bae4a5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:27.884509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8b62b5db-e420-4c76-9154-a2eb21bae4a5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:27.903163 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8b62b5db-e420-4c76-9154-a2eb21bae4a5 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1241 microversion: 2.1 time: 0.192080 Jun 16 16:18:27.904127 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 339/668] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:27 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1241 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:28.419125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-af32240b-6904-4c4e-a9e7-7d5702c8f797 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:28.420532 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-af32240b-6904-4c4e-a9e7-7d5702c8f797 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:28.442361 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af32240b-6904-4c4e-a9e7-7d5702c8f797 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:28.443160 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af32240b-6904-4c4e-a9e7-7d5702c8f797 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:28.444954 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af32240b-6904-4c4e-a9e7-7d5702c8f797 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:28.446043 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af32240b-6904-4c4e-a9e7-7d5702c8f797 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:28.502039 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-af32240b-6904-4c4e-a9e7-7d5702c8f797 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088032 Jun 16 16:18:28.503247 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 330/669] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:18:28 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:18:28.577640 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-2a262d29-dd18-43c5-a9bc-65f0b95c66f4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:28.578237 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2a262d29-dd18-43c5-a9bc-65f0b95c66f4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:28.586625 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2a262d29-dd18-43c5-a9bc-65f0b95c66f4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:28.587695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2a262d29-dd18-43c5-a9bc-65f0b95c66f4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:28.588483 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2a262d29-dd18-43c5-a9bc-65f0b95c66f4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:28.588922 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2a262d29-dd18-43c5-a9bc-65f0b95c66f4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:28.622727 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2a262d29-dd18-43c5-a9bc-65f0b95c66f4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Going to try to terminate instance {{(pid=117756) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:18:28.725657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-2a262d29-dd18-43c5-a9bc-65f0b95c66f4 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 204 len: 0 microversion: 2.1 time: 0.151967 Jun 16 16:18:28.726586 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 340/670] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:18:28 2022] DELETE /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:18:28.735543 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3f6fd863-625a-4007-8492-606ed9774b4c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:28.736284 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3f6fd863-625a-4007-8492-606ed9774b4c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:28.742892 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f6fd863-625a-4007-8492-606ed9774b4c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:28.743343 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f6fd863-625a-4007-8492-606ed9774b4c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:28.744127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f6fd863-625a-4007-8492-606ed9774b4c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:28.744569 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3f6fd863-625a-4007-8492-606ed9774b4c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:28.925780 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-0f641d58-d932-4958-9306-3c620c0fd797 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:28.926830 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-0f641d58-d932-4958-9306-3c620c0fd797 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:28.944360 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0f641d58-d932-4958-9306-3c620c0fd797 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:28.946906 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0f641d58-d932-4958-9306-3c620c0fd797 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:28.948515 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0f641d58-d932-4958-9306-3c620c0fd797 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:28.949782 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0f641d58-d932-4958-9306-3c620c0fd797 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:28.953609 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3f6fd863-625a-4007-8492-606ed9774b4c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:28.965211 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3f6fd863-625a-4007-8492-606ed9774b4c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1672 microversion: 2.1 time: 0.233756 Jun 16 16:18:28.966100 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 331/671] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:28 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1672 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:29.091268 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-72c37a37-77e0-4171-b44f-6a14a05468a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:29.091777 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-72c37a37-77e0-4171-b44f-6a14a05468a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:29.097235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-0f641d58-d932-4958-9306-3c620c0fd797 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:29.103068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-72c37a37-77e0-4171-b44f-6a14a05468a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:29.103516 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-72c37a37-77e0-4171-b44f-6a14a05468a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:29.104750 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-72c37a37-77e0-4171-b44f-6a14a05468a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:29.105406 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-72c37a37-77e0-4171-b44f-6a14a05468a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:29.107586 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-0f641d58-d932-4958-9306-3c620c0fd797 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1301 microversion: 2.1 time: 0.189878 Jun 16 16:18:29.108213 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 341/672] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:28 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1301 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:29.115762 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-3a27a6b0-0234-42e1-bb32-7c7568359543 req-bd47eec8-64b3-49f1-8124-67c72804d3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822d94ad-db52-4de9-8dfe-e3317ec09961", "tag": "5082da5f-5306-4a23-b35d-d8a60373485c"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:29.127718 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-3a27a6b0-0234-42e1-bb32-7c7568359543 req-bd47eec8-64b3-49f1-8124-67c72804d3a5 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:29.128165 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-3a27a6b0-0234-42e1-bb32-7c7568359543 req-bd47eec8-64b3-49f1-8124-67c72804d3a5 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:29.141584 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-3a27a6b0-0234-42e1-bb32-7c7568359543 req-bd47eec8-64b3-49f1-8124-67c72804d3a5 service nova] Creating event network-changed:5082da5f-5306-4a23-b35d-d8a60373485c for instance 822d94ad-db52-4de9-8dfe-e3317ec09961 on hv-cinder-83716 Jun 16 16:18:29.150312 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-3a27a6b0-0234-42e1-bb32-7c7568359543 req-bd47eec8-64b3-49f1-8124-67c72804d3a5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040144 Jun 16 16:18:29.151500 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 342/673] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:29.216381 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-72c37a37-77e0-4171-b44f-6a14a05468a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lazy-loading 'services' on Instance uuid 822d94ad-db52-4de9-8dfe-e3317ec09961 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:18:29.303529 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-72c37a37-77e0-4171-b44f-6a14a05468a9 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "DELETE /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments/d0abaa64-5750-484a-b80d-05af11e3add7" status: 202 len: 0 microversion: 2.1 time: 0.215972 Jun 16 16:18:29.304142 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 332/674] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 16:18:29 2022] DELETE /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments/d0abaa64-5750-484a-b80d-05af11e3add7 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:18:29.313825 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-23fb0419-e01e-442d-9a35-3f2fef4b8122 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:29.315627 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-23fb0419-e01e-442d-9a35-3f2fef4b8122 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:29.324578 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-23fb0419-e01e-442d-9a35-3f2fef4b8122 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:29.325067 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-23fb0419-e01e-442d-9a35-3f2fef4b8122 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:29.325878 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-23fb0419-e01e-442d-9a35-3f2fef4b8122 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:29.326362 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-23fb0419-e01e-442d-9a35-3f2fef4b8122 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:29.332652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:29.380197 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-23fb0419-e01e-442d-9a35-3f2fef4b8122 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070838 Jun 16 16:18:29.380875 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 343/675] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:18:29 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:18:29.991780 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6a8572e1-9d96-44bb-97fd-8bba7daf31dd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:29.993830 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6a8572e1-9d96-44bb-97fd-8bba7daf31dd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:30.027297 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6a8572e1-9d96-44bb-97fd-8bba7daf31dd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:30.028131 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6a8572e1-9d96-44bb-97fd-8bba7daf31dd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:30.030550 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6a8572e1-9d96-44bb-97fd-8bba7daf31dd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:30.031362 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6a8572e1-9d96-44bb-97fd-8bba7daf31dd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:30.129818 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-9fa16408-6843-4451-bea4-9a52ad6d5a6b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:30.130798 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-9fa16408-6843-4451-bea4-9a52ad6d5a6b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:30.145022 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9fa16408-6843-4451-bea4-9a52ad6d5a6b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:30.145832 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9fa16408-6843-4451-bea4-9a52ad6d5a6b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:30.147103 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9fa16408-6843-4451-bea4-9a52ad6d5a6b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:30.147703 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9fa16408-6843-4451-bea4-9a52ad6d5a6b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:30.271375 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-9fa16408-6843-4451-bea4-9a52ad6d5a6b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:30.299567 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-9fa16408-6843-4451-bea4-9a52ad6d5a6b tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1311 microversion: 2.1 time: 0.174760 Jun 16 16:18:30.318447 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 344/676] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:30 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1311 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:30.349439 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6a8572e1-9d96-44bb-97fd-8bba7daf31dd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:30.359479 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6a8572e1-9d96-44bb-97fd-8bba7daf31dd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1672 microversion: 2.1 time: 0.375114 Jun 16 16:18:30.371331 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 333/677] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:29 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1672 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:30.394361 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-243e8097-30af-4006-8ad9-e1e72984b561 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:30.395488 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-243e8097-30af-4006-8ad9-e1e72984b561 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:30.405986 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-243e8097-30af-4006-8ad9-e1e72984b561 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:30.406544 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-243e8097-30af-4006-8ad9-e1e72984b561 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:30.407755 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-243e8097-30af-4006-8ad9-e1e72984b561 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:30.408860 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-243e8097-30af-4006-8ad9-e1e72984b561 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:30.451840 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-243e8097-30af-4006-8ad9-e1e72984b561 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062072 Jun 16 16:18:30.452837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 345/678] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:18:30 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:31.334050 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-32687db6-73b4-425e-a2ee-a80ee835ec2a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:31.334986 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-32687db6-73b4-425e-a2ee-a80ee835ec2a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:31.342599 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-32687db6-73b4-425e-a2ee-a80ee835ec2a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:31.343087 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-32687db6-73b4-425e-a2ee-a80ee835ec2a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:31.343969 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-32687db6-73b4-425e-a2ee-a80ee835ec2a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:31.344867 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-32687db6-73b4-425e-a2ee-a80ee835ec2a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:31.382247 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-086725ff-7aef-4e40-930e-69ae66e4672f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:31.384374 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-086725ff-7aef-4e40-930e-69ae66e4672f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:31.396100 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-086725ff-7aef-4e40-930e-69ae66e4672f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:31.397040 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-086725ff-7aef-4e40-930e-69ae66e4672f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:31.399289 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-086725ff-7aef-4e40-930e-69ae66e4672f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:31.399957 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-086725ff-7aef-4e40-930e-69ae66e4672f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:31.580555 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-086725ff-7aef-4e40-930e-69ae66e4672f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:31.592582 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-086725ff-7aef-4e40-930e-69ae66e4672f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1605 microversion: 2.1 time: 0.216431 Jun 16 16:18:31.593165 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 346/679] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:31 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:31.599602 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c92a625d-ad4d-4aed-900a-5982c6128448 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:31.600708 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c92a625d-ad4d-4aed-900a-5982c6128448 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:31.616688 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c92a625d-ad4d-4aed-900a-5982c6128448 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:31.617146 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c92a625d-ad4d-4aed-900a-5982c6128448 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:31.618467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c92a625d-ad4d-4aed-900a-5982c6128448 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:31.618609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c92a625d-ad4d-4aed-900a-5982c6128448 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:31.640333 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-32687db6-73b4-425e-a2ee-a80ee835ec2a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:31.651265 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-32687db6-73b4-425e-a2ee-a80ee835ec2a tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1366 microversion: 2.1 time: 0.323493 Jun 16 16:18:31.661834 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 334/680] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:31 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:31.680553 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c92a625d-ad4d-4aed-900a-5982c6128448 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085788 Jun 16 16:18:31.681466 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 347/681] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:18:31 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:32.215216 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-d99e8819-a128-4e3c-8c7f-d235205d59bd req-ed4c2210-a54f-48da-802d-c6057cc4479b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b69f513-c146-469b-9045-a974844f18cb", "name": "network-vif-deleted", "tag": "b45f5873-c9a8-45d9-883c-9f0d81681036"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:32.221638 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:32.229668 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-d99e8819-a128-4e3c-8c7f-d235205d59bd req-ed4c2210-a54f-48da-802d-c6057cc4479b service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:32.230137 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-d99e8819-a128-4e3c-8c7f-d235205d59bd req-ed4c2210-a54f-48da-802d-c6057cc4479b service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:32.245533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-d99e8819-a128-4e3c-8c7f-d235205d59bd req-ed4c2210-a54f-48da-802d-c6057cc4479b service nova] Creating event network-vif-deleted:b45f5873-c9a8-45d9-883c-9f0d81681036 for instance 6b69f513-c146-469b-9045-a974844f18cb on hv-cinder-83716 Jun 16 16:18:32.255024 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-d99e8819-a128-4e3c-8c7f-d235205d59bd req-ed4c2210-a54f-48da-802d-c6057cc4479b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044068 Jun 16 16:18:32.255742 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 335/682] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:32.619736 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-eafed662-33ff-4053-b437-78a183fb35dc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:32.620726 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-eafed662-33ff-4053-b437-78a183fb35dc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:32.630596 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-eafed662-33ff-4053-b437-78a183fb35dc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:32.630973 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-eafed662-33ff-4053-b437-78a183fb35dc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:32.631805 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-eafed662-33ff-4053-b437-78a183fb35dc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:32.632237 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-eafed662-33ff-4053-b437-78a183fb35dc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:32.672848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bdcc2e0e-54c7-4db5-8722-0d269f63d2cf tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:32.675587 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bdcc2e0e-54c7-4db5-8722-0d269f63d2cf tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:32.683357 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-eafed662-33ff-4053-b437-78a183fb35dc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:32.683798 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-eafed662-33ff-4053-b437-78a183fb35dc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:32.684432 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-eafed662-33ff-4053-b437-78a183fb35dc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lazy-loading 'fault' on Instance uuid 6b69f513-c146-469b-9045-a974844f18cb {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:18:32.688475 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bdcc2e0e-54c7-4db5-8722-0d269f63d2cf tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:32.689256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bdcc2e0e-54c7-4db5-8722-0d269f63d2cf tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:32.690618 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bdcc2e0e-54c7-4db5-8722-0d269f63d2cf tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:32.691205 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bdcc2e0e-54c7-4db5-8722-0d269f63d2cf tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:32.789146 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-eafed662-33ff-4053-b437-78a183fb35dc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:32.816312 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-eafed662-33ff-4053-b437-78a183fb35dc tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 200 len: 1326 microversion: 2.1 time: 0.200808 Jun 16 16:18:32.833964 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 348/683] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:32 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 1326 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:32.833964 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-26e9c2af-bcea-47b5-a0a4-c2d685d44f5c tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:32.833964 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-26e9c2af-bcea-47b5-a0a4-c2d685d44f5c tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:32.844775 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-26e9c2af-bcea-47b5-a0a4-c2d685d44f5c tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:32.845734 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-26e9c2af-bcea-47b5-a0a4-c2d685d44f5c tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:32.846855 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-26e9c2af-bcea-47b5-a0a4-c2d685d44f5c tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:32.847402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-26e9c2af-bcea-47b5-a0a4-c2d685d44f5c tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:32.934973 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-26e9c2af-bcea-47b5-a0a4-c2d685d44f5c tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113271 Jun 16 16:18:32.936278 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 349/684] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:18:32 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:32.955464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bdcc2e0e-54c7-4db5-8722-0d269f63d2cf tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:32.974265 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bdcc2e0e-54c7-4db5-8722-0d269f63d2cf tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1366 microversion: 2.1 time: 0.307748 Jun 16 16:18:32.974935 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 336/685] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:32 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:33.857987 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-71a76a8c-8fbc-4975-a396-84dcbda3baa6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:33.862099 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-71a76a8c-8fbc-4975-a396-84dcbda3baa6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:33.882875 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:33.891370 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-71a76a8c-8fbc-4975-a396-84dcbda3baa6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:33.893545 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-71a76a8c-8fbc-4975-a396-84dcbda3baa6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:33.896322 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-71a76a8c-8fbc-4975-a396-84dcbda3baa6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:33.897125 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-71a76a8c-8fbc-4975-a396-84dcbda3baa6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:33.926195 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-71a76a8c-8fbc-4975-a396-84dcbda3baa6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] HTTP exception thrown: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-71a76a8c-8fbc-4975-a396-84dcbda3baa6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Request method failure captured: Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb HTTP/1.1 Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ZRrQp__f6SLjqkoqjcqf5q2cHKur69wKGyf-JZAkh2Osl2zjbqWmQ87ZwE5jD4g09TAMOuP_NMdYQwfLAtXKqvkmrY835B_C87-j943ATc5vqTteguBtYpVP6ouGL5hoKOVTg16H6Yvm6-Pf5EsAbCnDkwS4RGY3rxnfBY3D42i0M Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 34323d7e571b4f1db4d6e0c6cd1159cc Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:18:33.927867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:18:33.929458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34323d7e571b4f1db4d6e0c6cd1159cc"}]}] Jun 16 16:18:33.929458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:18:33.929458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 34323d7e571b4f1db4d6e0c6cd1159cc Jun 16 16:18:33.929458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:18:33.929458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-AttachVolumeTestJSON-1247911332-project Jun 16 16:18:33.929458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:18:33.929458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:18:33.929458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 80386d7afc994931af05fd49fa8043d6 Jun 16 16:18:33.929458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-AttachVolumeTestJSON-1247911332-project Jun 16 16:18:33.929458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:18:33.929458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. Jun 16 16:18:33.929458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': '6b69f513-c146-469b-9045-a974844f18cb'} Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:18:33.930529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. Jun 16 16:18:33.932012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:33.934038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-71a76a8c-8fbc-4975-a396-84dcbda3baa6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Returning 404 to user: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:18:33.934038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-71a76a8c-8fbc-4975-a396-84dcbda3baa6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 404 len: 111 microversion: 2.1 time: 0.082139 Jun 16 16:18:33.934038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 350/686] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:33 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:18:33.959379 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5aa2170b-4afc-4466-8e88-0254273b2311 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '.version_select at 0x7f38bb47dc10>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:33.962498 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e1c8a07c-4706-4e55-84fb-259fca04c7ba tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:33.963668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e1c8a07c-4706-4e55-84fb-259fca04c7ba tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:33.975472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1c8a07c-4706-4e55-84fb-259fca04c7ba tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:33.976234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1c8a07c-4706-4e55-84fb-259fca04c7ba tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:33.977490 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1c8a07c-4706-4e55-84fb-259fca04c7ba tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:33.978271 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e1c8a07c-4706-4e55-84fb-259fca04c7ba tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:33.995953 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5aa2170b-4afc-4466-8e88-0254273b2311 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-179900669" status: 202 len: 0 microversion: 2.1 time: 0.060732 Jun 16 16:18:33.996971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 337/687] 10.222.0.17 () {58 vars in 1217 bytes} [Thu Jun 16 16:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-179900669 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:18:34.008133 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7c0800c1-b6fd-4cac-b52c-4cbba4d09963 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:34.026977 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7c0800c1-b6fd-4cac-b52c-4cbba4d09963 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:34.042875 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7c0800c1-b6fd-4cac-b52c-4cbba4d09963 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:34.043782 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e1c8a07c-4706-4e55-84fb-259fca04c7ba tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083939 Jun 16 16:18:34.045908 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 351/688] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:18:33 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:18:34.053484 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7c0800c1-b6fd-4cac-b52c-4cbba4d09963 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:34.055020 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7c0800c1-b6fd-4cac-b52c-4cbba4d09963 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:34.055774 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7c0800c1-b6fd-4cac-b52c-4cbba4d09963 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:34.065323 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ad14c0e0-fd60-463b-ab0a-d6dad0cd7b1f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:34.067061 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ad14c0e0-fd60-463b-ab0a-d6dad0cd7b1f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:34.077950 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ad14c0e0-fd60-463b-ab0a-d6dad0cd7b1f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:34.079078 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ad14c0e0-fd60-463b-ab0a-d6dad0cd7b1f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:34.082421 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ad14c0e0-fd60-463b-ab0a-d6dad0cd7b1f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:34.083762 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ad14c0e0-fd60-463b-ab0a-d6dad0cd7b1f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:34.184131 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-ad14c0e0-fd60-463b-ab0a-d6dad0cd7b1f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] HTTP exception thrown: Instance 822d94ad-db52-4de9-8dfe-e3317ec09961 is not attached to volume d0abaa64-5750-484a-b80d-05af11e3add7 Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ad14c0e0-fd60-463b-ab0a-d6dad0cd7b1f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Request method failure captured: Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: DELETE /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments/d0abaa64-5750-484a-b80d-05af11e3add7 HTTP/1.1 Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1bzHNZnJYjMu2X_1-kUZhE7x0zvvGbgwRfXpGtuVrnLyTuZYY_e6mW47NhJEHHoU03u4rUn3rbjbu8OE2lUkBfaJnOSHwlYyUh1dZ_1SZUlOjZOLf0ZaB53xEi3PS1N8wEBC2kfiSoWQBWxL-K5V_dmfJrTV9qLJ-2Xvh4f2YANZhc Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 925cc45674694931bfe8fc60765045c2 Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-TestMinimumBasicScenario-1680913471 Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:18:34.186506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:18:34.189590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_925cc45674694931bfe8fc60765045c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/925cc45674694931bfe8fc60765045c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/925cc45674694931bfe8fc60765045c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/925cc45674694931bfe8fc60765045c2"}]}] Jun 16 16:18:34.189590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-TestMinimumBasicScenario-1680913471 Jun 16 16:18:34.189590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 925cc45674694931bfe8fc60765045c2 Jun 16 16:18:34.189590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1680913471 Jun 16 16:18:34.189590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-TestMinimumBasicScenario-1680913471-project Jun 16 16:18:34.189590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:18:34.189590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:18:34.189590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: c0da50b34820422193be2b06e0da2837 Jun 16 16:18:34.189590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-TestMinimumBasicScenario-1680913471-project Jun 16 16:18:34.189590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:18:34.189590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance 822d94ad-db52-4de9-8dfe-e3317ec09961 is not attached to volume d0abaa64-5750-484a-b80d-05af11e3add7 Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'server_id': '822d94ad-db52-4de9-8dfe-e3317ec09961', 'id': 'd0abaa64-5750-484a-b80d-05af11e3add7'} Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d0abaa64-5750-484a-b80d-05af11e3add7. Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:18:34.190663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:18:34.192035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:18:34.192035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 16:18:34.192035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 16:18:34.192035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 822d94ad-db52-4de9-8dfe-e3317ec09961 is not attached to volume d0abaa64-5750-484a-b80d-05af11e3add7 Jun 16 16:18:34.192035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:34.192035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:18:34.192035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:34.192035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:34.192035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:18:34.192035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:18:34.192035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:18:34.192035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:18:34.192035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 822d94ad-db52-4de9-8dfe-e3317ec09961 is not attached to volume d0abaa64-5750-484a-b80d-05af11e3add7 Jun 16 16:18:34.192035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:34.192035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ad14c0e0-fd60-463b-ab0a-d6dad0cd7b1f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Returning 404 to user: Instance 822d94ad-db52-4de9-8dfe-e3317ec09961 is not attached to volume d0abaa64-5750-484a-b80d-05af11e3add7 {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:18:34.193524 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ad14c0e0-fd60-463b-ab0a-d6dad0cd7b1f tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "DELETE /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments/d0abaa64-5750-484a-b80d-05af11e3add7" status: 404 len: 154 microversion: 2.1 time: 0.132659 Jun 16 16:18:34.193524 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 352/689] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 16:18:34 2022] DELETE /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961/os-volume_attachments/d0abaa64-5750-484a-b80d-05af11e3add7 => generated 154 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:18:34.275247 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7c0800c1-b6fd-4cac-b52c-4cbba4d09963 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:34.284973 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-53b94012-8958-47a7-bbc6-fc65b08e5a38 req-0de7035a-a83a-463e-90f6-962e9de18509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a345636a-18e8-47a4-94ae-64363ef57f55", "tag": "090307fe-9628-4c5e-8a8c-15b983b49709"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:34.293704 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7c0800c1-b6fd-4cac-b52c-4cbba4d09963 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1366 microversion: 2.1 time: 0.294484 Jun 16 16:18:34.305953 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 338/690] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:33 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:34.306184 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-53b94012-8958-47a7-bbc6-fc65b08e5a38 req-0de7035a-a83a-463e-90f6-962e9de18509 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:34.306184 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-53b94012-8958-47a7-bbc6-fc65b08e5a38 req-0de7035a-a83a-463e-90f6-962e9de18509 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:34.311177 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-53b94012-8958-47a7-bbc6-fc65b08e5a38 req-0de7035a-a83a-463e-90f6-962e9de18509 service nova] Creating event network-changed:090307fe-9628-4c5e-8a8c-15b983b49709 for instance a345636a-18e8-47a4-94ae-64363ef57f55 on hv-cinder-83716 Jun 16 16:18:34.318518 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-53b94012-8958-47a7-bbc6-fc65b08e5a38 req-0de7035a-a83a-463e-90f6-962e9de18509 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042793 Jun 16 16:18:34.330526 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 353/691] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:34.922944 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5d41e7a5-f85d-4aea-8518-18b5873af6be tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Action: 'create', calling method: .version_select at 0x7f38bb6cc280>, body: {"keypair": {"name": "tempest-keypair-1921607216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvHHG8MXBgyDqNdDxXLxbIqxrdRatZbAbbbqqPCI4YXGQ41hnLGAuHA/bd9hS9bT+vrw55aqnykD14SkZl2tMaggEI8O+oeRgjzF/nxuXX54GsXaAkfH+y6r00N8gbFnQ=="}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:34.938009 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-5d41e7a5-f85d-4aea-8518-18b5873af6be tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Getting quotas for project 34323d7e571b4f1db4d6e0c6cd1159cc. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:18:34.943792 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-5d41e7a5-f85d-4aea-8518-18b5873af6be tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Getting quotas for user 80386d7afc994931af05fd49fa8043d6 and project 34323d7e571b4f1db4d6e0c6cd1159cc. Resources: {'key_pairs'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:18:34.967821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5d41e7a5-f85d-4aea-8518-18b5873af6be tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048829 Jun 16 16:18:34.968554 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 339/692] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 16:18:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:35.317746 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ab793ffc-dcbf-4c23-9766-c893cba1a62e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:35.318707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ab793ffc-dcbf-4c23-9766-c893cba1a62e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:35.325512 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ab793ffc-dcbf-4c23-9766-c893cba1a62e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:35.325995 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ab793ffc-dcbf-4c23-9766-c893cba1a62e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:35.326785 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ab793ffc-dcbf-4c23-9766-c893cba1a62e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:35.327430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ab793ffc-dcbf-4c23-9766-c893cba1a62e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:35.525703 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ab793ffc-dcbf-4c23-9766-c893cba1a62e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:35.534039 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ab793ffc-dcbf-4c23-9766-c893cba1a62e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1366 microversion: 2.1 time: 0.222235 Jun 16 16:18:35.534628 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 354/693] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:35 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:36.526607 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1171583186", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "abdff458-150a-4302-aaae-af8beb5c788c"}], "security_groups": [{"name": "tempest-securitygroup--485377368"}], "key_name": "tempest-keypair-1921607216", "user_data": "}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:36.551631 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-291c561f-cf3d-4ba1-8043-d1404aea12e7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:36.552358 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-291c561f-cf3d-4ba1-8043-d1404aea12e7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:36.560829 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-291c561f-cf3d-4ba1-8043-d1404aea12e7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:36.561421 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-291c561f-cf3d-4ba1-8043-d1404aea12e7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:36.562556 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-291c561f-cf3d-4ba1-8043-d1404aea12e7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:36.563236 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-291c561f-cf3d-4ba1-8043-d1404aea12e7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:36.658863 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] validate_networks() for [('abdff458-150a-4302-aaae-af8beb5c788c', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:18:36.742250 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-291c561f-cf3d-4ba1-8043-d1404aea12e7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:36.750643 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-291c561f-cf3d-4ba1-8043-d1404aea12e7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1366 microversion: 2.1 time: 0.203004 Jun 16 16:18:36.751466 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 355/694] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:36 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:37.163652 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:18:37.164265 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:18:37.164873 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:18:37.165416 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:18:37.165988 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:18:37.176755 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:37.177246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:37.178096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:37.178537 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:37.197360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Getting quotas for project 34323d7e571b4f1db4d6e0c6cd1159cc. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:18:37.202335 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Getting quotas for user 80386d7afc994931af05fd49fa8043d6 and project 34323d7e571b4f1db4d6e0c6cd1159cc. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:18:37.215646 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:18:37.217958 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:18:37.276416 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b00dc47a-4e5d-4d39-9a94-1b53cbe13399 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.754840 Jun 16 16:18:37.277128 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 340/695] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:18:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:18:37.292537 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-252dfd2a-aef6-416b-afa4-091e5535b0c7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:37.293351 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-252dfd2a-aef6-416b-afa4-091e5535b0c7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:37.363959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-252dfd2a-aef6-416b-afa4-091e5535b0c7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:37.374955 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-252dfd2a-aef6-416b-afa4-091e5535b0c7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1238 microversion: 2.1 time: 0.086153 Jun 16 16:18:37.375661 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 356/696] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:37 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:37.518959 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c0cc6ff9-abfd-49e9-924a-0380f5c130c3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:37.519518 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c0cc6ff9-abfd-49e9-924a-0380f5c130c3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:37.527565 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c0cc6ff9-abfd-49e9-924a-0380f5c130c3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:37.528443 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c0cc6ff9-abfd-49e9-924a-0380f5c130c3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:37.528826 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c0cc6ff9-abfd-49e9-924a-0380f5c130c3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:37.529269 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c0cc6ff9-abfd-49e9-924a-0380f5c130c3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:37.561458 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c0cc6ff9-abfd-49e9-924a-0380f5c130c3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:18:37.694058 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c0cc6ff9-abfd-49e9-924a-0380f5c130c3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "DELETE /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 204 len: 0 microversion: 2.1 time: 0.179327 Jun 16 16:18:37.696809 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 341/697] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:18:37 2022] DELETE /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:18:37.707985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8a3c3a43-8fa2-4e52-a162-bdad56eab655 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:37.708610 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8a3c3a43-8fa2-4e52-a162-bdad56eab655 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:37.715864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8a3c3a43-8fa2-4e52-a162-bdad56eab655 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:37.716317 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8a3c3a43-8fa2-4e52-a162-bdad56eab655 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:37.717123 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8a3c3a43-8fa2-4e52-a162-bdad56eab655 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:37.717565 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8a3c3a43-8fa2-4e52-a162-bdad56eab655 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:37.772105 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9d21d758-c756-49b7-905c-c86d0899c25e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:37.772839 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9d21d758-c756-49b7-905c-c86d0899c25e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:37.788077 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9d21d758-c756-49b7-905c-c86d0899c25e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:37.788899 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9d21d758-c756-49b7-905c-c86d0899c25e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:37.789737 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9d21d758-c756-49b7-905c-c86d0899c25e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:37.790239 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9d21d758-c756-49b7-905c-c86d0899c25e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:37.901833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8a3c3a43-8fa2-4e52-a162-bdad56eab655 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:37.913180 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8a3c3a43-8fa2-4e52-a162-bdad56eab655 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1555 microversion: 2.1 time: 0.210313 Jun 16 16:18:37.914218 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 357/698] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:37 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1555 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:37.974187 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9d21d758-c756-49b7-905c-c86d0899c25e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:37.992246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9d21d758-c756-49b7-905c-c86d0899c25e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1366 microversion: 2.1 time: 0.226822 Jun 16 16:18:37.996339 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 342/699] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:37 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:38.395655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-375daa9c-5932-4cc6-ab81-16320c25b2df tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:38.396277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-375daa9c-5932-4cc6-ab81-16320c25b2df tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:38.405838 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-375daa9c-5932-4cc6-ab81-16320c25b2df tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:38.406478 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-375daa9c-5932-4cc6-ab81-16320c25b2df tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:38.407854 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-375daa9c-5932-4cc6-ab81-16320c25b2df tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:38.408647 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-375daa9c-5932-4cc6-ab81-16320c25b2df tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:38.478600 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-375daa9c-5932-4cc6-ab81-16320c25b2df tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:38.486592 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-375daa9c-5932-4cc6-ab81-16320c25b2df tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1242 microversion: 2.1 time: 0.096437 Jun 16 16:18:38.487185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 358/700] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:38 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:38.939868 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a6c0b2d9-3b4c-4ef6-b286-b4b7f5ed0696 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:38.940490 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a6c0b2d9-3b4c-4ef6-b286-b4b7f5ed0696 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:38.950329 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a6c0b2d9-3b4c-4ef6-b286-b4b7f5ed0696 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:38.950783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a6c0b2d9-3b4c-4ef6-b286-b4b7f5ed0696 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:38.951566 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a6c0b2d9-3b4c-4ef6-b286-b4b7f5ed0696 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:38.952054 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a6c0b2d9-3b4c-4ef6-b286-b4b7f5ed0696 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:39.013689 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-dcd1ebde-a292-41f3-b671-1499d0807f54 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:39.015297 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-dcd1ebde-a292-41f3-b671-1499d0807f54 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:39.023829 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dcd1ebde-a292-41f3-b671-1499d0807f54 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:39.024286 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dcd1ebde-a292-41f3-b671-1499d0807f54 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:39.025090 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dcd1ebde-a292-41f3-b671-1499d0807f54 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:39.025627 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dcd1ebde-a292-41f3-b671-1499d0807f54 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:39.106879 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a6c0b2d9-3b4c-4ef6-b286-b4b7f5ed0696 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:39.122778 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a6c0b2d9-3b4c-4ef6-b286-b4b7f5ed0696 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1555 microversion: 2.1 time: 0.187356 Jun 16 16:18:39.124127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 343/701] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:38 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1555 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:39.208163 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-dcd1ebde-a292-41f3-b671-1499d0807f54 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:39.216092 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-dcd1ebde-a292-41f3-b671-1499d0807f54 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1366 microversion: 2.1 time: 0.206413 Jun 16 16:18:39.216688 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 359/702] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:39 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:39.504665 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5d465291-146c-4f20-985e-56161f8dc203 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:39.505287 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5d465291-146c-4f20-985e-56161f8dc203 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:39.512132 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d465291-146c-4f20-985e-56161f8dc203 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:39.512581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d465291-146c-4f20-985e-56161f8dc203 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:39.513368 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d465291-146c-4f20-985e-56161f8dc203 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:39.513801 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d465291-146c-4f20-985e-56161f8dc203 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:39.585408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5d465291-146c-4f20-985e-56161f8dc203 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:39.595127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5d465291-146c-4f20-985e-56161f8dc203 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1242 microversion: 2.1 time: 0.094908 Jun 16 16:18:39.595994 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 344/703] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:39 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:40.141981 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-166391d5-ef31-4162-9b32-faf7615e20f3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:40.143031 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-166391d5-ef31-4162-9b32-faf7615e20f3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:40.149474 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-166391d5-ef31-4162-9b32-faf7615e20f3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:40.149870 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-166391d5-ef31-4162-9b32-faf7615e20f3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:40.150674 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-166391d5-ef31-4162-9b32-faf7615e20f3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:40.151111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-166391d5-ef31-4162-9b32-faf7615e20f3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:40.232861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-60a385cd-d97c-40cf-a966-e5a00ad07bc9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:40.233537 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-60a385cd-d97c-40cf-a966-e5a00ad07bc9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:40.241312 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-60a385cd-d97c-40cf-a966-e5a00ad07bc9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:40.241770 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-60a385cd-d97c-40cf-a966-e5a00ad07bc9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:40.242576 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-60a385cd-d97c-40cf-a966-e5a00ad07bc9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:40.243201 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-60a385cd-d97c-40cf-a966-e5a00ad07bc9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:40.319257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-166391d5-ef31-4162-9b32-faf7615e20f3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:40.327858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-166391d5-ef31-4162-9b32-faf7615e20f3 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1555 microversion: 2.1 time: 0.189700 Jun 16 16:18:40.328727 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 360/704] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:40 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:40.405584 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-60a385cd-d97c-40cf-a966-e5a00ad07bc9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:40.421878 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-60a385cd-d97c-40cf-a966-e5a00ad07bc9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1366 microversion: 2.1 time: 0.192962 Jun 16 16:18:40.427944 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 345/705] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:40 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:40.614846 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-433c0f16-5ddd-4657-8729-46e3e0871a91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:40.615685 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-433c0f16-5ddd-4657-8729-46e3e0871a91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:40.622225 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-433c0f16-5ddd-4657-8729-46e3e0871a91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:40.622682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-433c0f16-5ddd-4657-8729-46e3e0871a91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:40.623460 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-433c0f16-5ddd-4657-8729-46e3e0871a91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:40.623900 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-433c0f16-5ddd-4657-8729-46e3e0871a91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:40.687888 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-433c0f16-5ddd-4657-8729-46e3e0871a91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:40.692852 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=100 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:40.698459 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-433c0f16-5ddd-4657-8729-46e3e0871a91 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1242 microversion: 2.1 time: 0.087406 Jun 16 16:18:40.699041 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 361/706] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:40 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:41.355396 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-cd16dda1-392b-4dc2-bc9d-ffceeebdeaa6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:41.356059 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-cd16dda1-392b-4dc2-bc9d-ffceeebdeaa6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:41.364230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cd16dda1-392b-4dc2-bc9d-ffceeebdeaa6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:41.364780 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cd16dda1-392b-4dc2-bc9d-ffceeebdeaa6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:41.365580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cd16dda1-392b-4dc2-bc9d-ffceeebdeaa6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:41.366135 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-cd16dda1-392b-4dc2-bc9d-ffceeebdeaa6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:41.441853 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-462ac791-a232-42b5-8763-42213786ce33 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:41.443066 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-462ac791-a232-42b5-8763-42213786ce33 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:41.451329 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-462ac791-a232-42b5-8763-42213786ce33 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:41.452020 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-462ac791-a232-42b5-8763-42213786ce33 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:41.453250 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-462ac791-a232-42b5-8763-42213786ce33 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:41.454087 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-462ac791-a232-42b5-8763-42213786ce33 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:41.567470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-cd16dda1-392b-4dc2-bc9d-ffceeebdeaa6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:41.571071 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:41.582844 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-cd16dda1-392b-4dc2-bc9d-ffceeebdeaa6 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1555 microversion: 2.1 time: 0.232393 Jun 16 16:18:41.584065 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 346/707] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:41 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1555 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:41.648154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-462ac791-a232-42b5-8763-42213786ce33 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:41.655780 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-462ac791-a232-42b5-8763-42213786ce33 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1366 microversion: 2.1 time: 0.219706 Jun 16 16:18:41.656562 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 362/708] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:41 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:41.717602 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b6aeab12-f39f-4799-bfcc-0b6aec64d6d3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:41.718948 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b6aeab12-f39f-4799-bfcc-0b6aec64d6d3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:41.726776 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6aeab12-f39f-4799-bfcc-0b6aec64d6d3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:41.727235 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6aeab12-f39f-4799-bfcc-0b6aec64d6d3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:41.728066 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6aeab12-f39f-4799-bfcc-0b6aec64d6d3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:41.728540 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6aeab12-f39f-4799-bfcc-0b6aec64d6d3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:41.807176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b6aeab12-f39f-4799-bfcc-0b6aec64d6d3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:41.819999 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b6aeab12-f39f-4799-bfcc-0b6aec64d6d3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1234 microversion: 2.1 time: 0.106536 Jun 16 16:18:41.820959 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 347/709] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:41 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1234 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:42.604290 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d7dd94da-60f5-40d7-a9ac-0655492149e4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:42.604923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d7dd94da-60f5-40d7-a9ac-0655492149e4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:42.614802 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d7dd94da-60f5-40d7-a9ac-0655492149e4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:42.615898 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d7dd94da-60f5-40d7-a9ac-0655492149e4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:42.618126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d7dd94da-60f5-40d7-a9ac-0655492149e4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:42.619052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d7dd94da-60f5-40d7-a9ac-0655492149e4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:42.678307 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-41a4c974-5b72-4c2c-967d-3f9007549172 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:42.679388 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-41a4c974-5b72-4c2c-967d-3f9007549172 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:42.691711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-41a4c974-5b72-4c2c-967d-3f9007549172 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:42.692651 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-41a4c974-5b72-4c2c-967d-3f9007549172 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:42.693917 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-41a4c974-5b72-4c2c-967d-3f9007549172 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:42.694634 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-41a4c974-5b72-4c2c-967d-3f9007549172 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:42.880414 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-41a4c974-5b72-4c2c-967d-3f9007549172 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:42.903011 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-41a4c974-5b72-4c2c-967d-3f9007549172 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1366 microversion: 2.1 time: 0.233287 Jun 16 16:18:42.903668 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 348/710] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:42 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:42.909186 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-09add45f-16fc-48f9-a083-a2d3a6602b6f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:42.913601 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-09add45f-16fc-48f9-a083-a2d3a6602b6f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:42.921873 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-09add45f-16fc-48f9-a083-a2d3a6602b6f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:42.922268 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-09add45f-16fc-48f9-a083-a2d3a6602b6f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:42.923168 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-09add45f-16fc-48f9-a083-a2d3a6602b6f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:42.924211 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-09add45f-16fc-48f9-a083-a2d3a6602b6f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:43.003743 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d7dd94da-60f5-40d7-a9ac-0655492149e4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0da50b34820422193be2b06e0da2837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925cc45674694931bfe8fc60765045c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:43.012119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d7dd94da-60f5-40d7-a9ac-0655492149e4 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 200 len: 1555 microversion: 2.1 time: 0.412618 Jun 16 16:18:43.013068 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 363/711] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:42 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 1555 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:43.030359 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-09add45f-16fc-48f9-a083-a2d3a6602b6f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:43.044306 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-09add45f-16fc-48f9-a083-a2d3a6602b6f tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1298 microversion: 2.1 time: 0.139436 Jun 16 16:18:43.051817 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 349/712] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:42 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1298 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:43.185956 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-df361534-63fa-4a0e-8e70-c968ecc916b9 req-db081841-85b9-42ca-bf47-293d69af8822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822d94ad-db52-4de9-8dfe-e3317ec09961", "name": "network-vif-deleted", "tag": "5082da5f-5306-4a23-b35d-d8a60373485c"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:43.198532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-df361534-63fa-4a0e-8e70-c968ecc916b9 req-db081841-85b9-42ca-bf47-293d69af8822 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:43.199146 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-df361534-63fa-4a0e-8e70-c968ecc916b9 req-db081841-85b9-42ca-bf47-293d69af8822 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:43.213179 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-df361534-63fa-4a0e-8e70-c968ecc916b9 req-db081841-85b9-42ca-bf47-293d69af8822 service nova] Creating event network-vif-deleted:5082da5f-5306-4a23-b35d-d8a60373485c for instance 822d94ad-db52-4de9-8dfe-e3317ec09961 on hv-cinder-83716 Jun 16 16:18:43.220159 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-df361534-63fa-4a0e-8e70-c968ecc916b9 req-db081841-85b9-42ca-bf47-293d69af8822 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039920 Jun 16 16:18:43.221083 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 364/713] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:18:43.699602 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-08736f63-e38a-4a25-9058-9d70b3ffce28 req-9418d7dd-2930-4506-a054-ca4a707d3767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a345636a-18e8-47a4-94ae-64363ef57f55", "name": "network-vif-plugged", "status": "completed", "tag": "090307fe-9628-4c5e-8a8c-15b983b49709"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:43.721291 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-08736f63-e38a-4a25-9058-9d70b3ffce28 req-9418d7dd-2930-4506-a054-ca4a707d3767 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:43.722067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-08736f63-e38a-4a25-9058-9d70b3ffce28 req-9418d7dd-2930-4506-a054-ca4a707d3767 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:43.743469 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-08736f63-e38a-4a25-9058-9d70b3ffce28 req-9418d7dd-2930-4506-a054-ca4a707d3767 service nova] Creating event network-vif-plugged:090307fe-9628-4c5e-8a8c-15b983b49709 for instance a345636a-18e8-47a4-94ae-64363ef57f55 on hv-cinder-83716 Jun 16 16:18:43.749456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-08736f63-e38a-4a25-9058-9d70b3ffce28 req-9418d7dd-2930-4506-a054-ca4a707d3767 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061544 Jun 16 16:18:43.750679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 350/714] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:43.927104 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3984cab0-2d38-4fa8-8c3e-8929b36f3b11 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:43.930060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3984cab0-2d38-4fa8-8c3e-8929b36f3b11 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:43.946943 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3984cab0-2d38-4fa8-8c3e-8929b36f3b11 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:43.948019 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3984cab0-2d38-4fa8-8c3e-8929b36f3b11 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:43.949083 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3984cab0-2d38-4fa8-8c3e-8929b36f3b11 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:43.949799 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3984cab0-2d38-4fa8-8c3e-8929b36f3b11 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:44.041918 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b1be9720-2147-4bbe-bbf3-f1dfd1898d02 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:44.042922 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b1be9720-2147-4bbe-bbf3-f1dfd1898d02 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] [instance: 822d94ad-db52-4de9-8dfe-e3317ec09961] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:44.057491 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b1be9720-2147-4bbe-bbf3-f1dfd1898d02 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:44.058476 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b1be9720-2147-4bbe-bbf3-f1dfd1898d02 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:44.059782 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b1be9720-2147-4bbe-bbf3-f1dfd1898d02 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:44.060652 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b1be9720-2147-4bbe-bbf3-f1dfd1898d02 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:44.090115 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-b1be9720-2147-4bbe-bbf3-f1dfd1898d02 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] HTTP exception thrown: Instance 822d94ad-db52-4de9-8dfe-e3317ec09961 could not be found. Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b1be9720-2147-4bbe-bbf3-f1dfd1898d02 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Request method failure captured: Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 HTTP/1.1 Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1bzHNZnJYjMu2X_1-kUZhE7x0zvvGbgwRfXpGtuVrnLyTuZYY_e6mW47NhJEHHoU03u4rUn3rbjbu8OE2lUkBfaJnOSHwlYyUh1dZ_1SZUlOjZOLf0ZaB53xEi3PS1N8wEBC2kfiSoWQBWxL-K5V_dmfJrTV9qLJ-2Xvh4f2YANZhc Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 925cc45674694931bfe8fc60765045c2 Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-TestMinimumBasicScenario-1680913471 Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:18:44.095657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:18:44.097821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_925cc45674694931bfe8fc60765045c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/925cc45674694931bfe8fc60765045c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/925cc45674694931bfe8fc60765045c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/925cc45674694931bfe8fc60765045c2"}]}] Jun 16 16:18:44.097821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-TestMinimumBasicScenario-1680913471 Jun 16 16:18:44.097821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 925cc45674694931bfe8fc60765045c2 Jun 16 16:18:44.097821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1680913471 Jun 16 16:18:44.097821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-TestMinimumBasicScenario-1680913471-project Jun 16 16:18:44.097821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:18:44.097821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:18:44.097821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: c0da50b34820422193be2b06e0da2837 Jun 16 16:18:44.097821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-TestMinimumBasicScenario-1680913471-project Jun 16 16:18:44.097821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:18:44.097821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance 822d94ad-db52-4de9-8dfe-e3317ec09961 could not be found. Jun 16 16:18:44.097821 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': '822d94ad-db52-4de9-8dfe-e3317ec09961'} Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 822d94ad-db52-4de9-8dfe-e3317ec09961 could not be found. Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:18:44.099082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 822d94ad-db52-4de9-8dfe-e3317ec09961 could not be found. Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 822d94ad-db52-4de9-8dfe-e3317ec09961 could not be found. Jun 16 16:18:44.100966 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:18:44.104965 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b1be9720-2147-4bbe-bbf3-f1dfd1898d02 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Returning 404 to user: Instance 822d94ad-db52-4de9-8dfe-e3317ec09961 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:18:44.106757 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b1be9720-2147-4bbe-bbf3-f1dfd1898d02 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961" status: 404 len: 111 microversion: 2.1 time: 0.070767 Jun 16 16:18:44.108575 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 351/715] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:44 2022] GET /compute/v2.1/servers/822d94ad-db52-4de9-8dfe-e3317ec09961 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:18:44.117952 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c284057b-3469-40b6-b1a6-f5c203b3494c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:44.119069 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c284057b-3469-40b6-b1a6-f5c203b3494c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:44.134658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c284057b-3469-40b6-b1a6-f5c203b3494c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:44.135140 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c284057b-3469-40b6-b1a6-f5c203b3494c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:44.135931 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c284057b-3469-40b6-b1a6-f5c203b3494c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:44.137060 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c284057b-3469-40b6-b1a6-f5c203b3494c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:44.235893 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3984cab0-2d38-4fa8-8c3e-8929b36f3b11 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:44.248196 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3984cab0-2d38-4fa8-8c3e-8929b36f3b11 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1366 microversion: 2.1 time: 0.329521 Jun 16 16:18:44.250787 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 365/716] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:43 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:44.264657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c11c2252-4548-4318-ac98-159442e410f7 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] Calling method '.version_select at 0x7f38bb6dd550>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:44.290901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c11c2252-4548-4318-ac98-159442e410f7 tempest-TestMinimumBasicScenario-1680913471 tempest-TestMinimumBasicScenario-1680913471-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1233643166" status: 202 len: 0 microversion: 2.1 time: 0.037807 Jun 16 16:18:44.291562 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 366/717] 10.222.0.17 () {58 vars in 1271 bytes} [Thu Jun 16 16:18:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1233643166 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:18:44.462907 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c284057b-3469-40b6-b1a6-f5c203b3494c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:44.473003 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c284057b-3469-40b6-b1a6-f5c203b3494c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1363 microversion: 2.1 time: 0.362628 Jun 16 16:18:44.474962 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 352/718] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:44 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1363 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:45.276442 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3f8eadfc-b776-4daf-a1b8-9e8a0f595c19 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:45.277641 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3f8eadfc-b776-4daf-a1b8-9e8a0f595c19 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:45.293239 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3f8eadfc-b776-4daf-a1b8-9e8a0f595c19 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:45.293775 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3f8eadfc-b776-4daf-a1b8-9e8a0f595c19 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:45.294713 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3f8eadfc-b776-4daf-a1b8-9e8a0f595c19 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:45.295408 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3f8eadfc-b776-4daf-a1b8-9e8a0f595c19 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:45.353513 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-67fec066-67a9-47c1-bcd4-94923445ec43 req-1665b739-4f4c-420d-b3d4-4f2941d7ba8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61ad4f5-127e-4836-ad7c-75ae01179424", "tag": "345d7505-2303-4cf6-ac18-5979aa4955be"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:45.381984 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-67fec066-67a9-47c1-bcd4-94923445ec43 req-1665b739-4f4c-420d-b3d4-4f2941d7ba8f service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:45.384196 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-67fec066-67a9-47c1-bcd4-94923445ec43 req-1665b739-4f4c-420d-b3d4-4f2941d7ba8f service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:45.408024 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-67fec066-67a9-47c1-bcd4-94923445ec43 req-1665b739-4f4c-420d-b3d4-4f2941d7ba8f service nova] Creating event network-changed:345d7505-2303-4cf6-ac18-5979aa4955be for instance d61ad4f5-127e-4836-ad7c-75ae01179424 on hv-cinder-83716 Jun 16 16:18:45.415889 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-67fec066-67a9-47c1-bcd4-94923445ec43 req-1665b739-4f4c-420d-b3d4-4f2941d7ba8f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067998 Jun 16 16:18:45.417161 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 353/719] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:45.500203 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f971a027-87db-496b-bb74-e52886690033 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:45.501943 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f971a027-87db-496b-bb74-e52886690033 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:45.513270 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f971a027-87db-496b-bb74-e52886690033 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:45.513987 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f971a027-87db-496b-bb74-e52886690033 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:45.515207 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f971a027-87db-496b-bb74-e52886690033 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:45.525614 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f971a027-87db-496b-bb74-e52886690033 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:45.868014 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f971a027-87db-496b-bb74-e52886690033 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:45.878333 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f971a027-87db-496b-bb74-e52886690033 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1363 microversion: 2.1 time: 0.385430 Jun 16 16:18:45.879283 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 354/720] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:45 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1363 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:45.889584 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d4dfe85a-6b10-42d1-a9d7-42037ae96863 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:45.890479 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d4dfe85a-6b10-42d1-a9d7-42037ae96863 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:45.900994 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4dfe85a-6b10-42d1-a9d7-42037ae96863 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:45.901780 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4dfe85a-6b10-42d1-a9d7-42037ae96863 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:45.903186 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4dfe85a-6b10-42d1-a9d7-42037ae96863 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:45.904012 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4dfe85a-6b10-42d1-a9d7-42037ae96863 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:45.989903 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3f8eadfc-b776-4daf-a1b8-9e8a0f595c19 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:46.000212 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3f8eadfc-b776-4daf-a1b8-9e8a0f595c19 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1366 microversion: 2.1 time: 0.729819 Jun 16 16:18:46.001305 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 367/721] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:45 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1366 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:46.036648 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-d4dfe85a-6b10-42d1-a9d7-42037ae96863 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lazy-loading 'services' on Instance uuid 3dcb1996-2963-4d45-bf74-e753c4ad9eee {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:18:46.134460 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d4dfe85a-6b10-42d1-a9d7-42037ae96863 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee/os-volume_attachments/6bab4f74-d090-4ea0-81f3-db3de0f86612" status: 202 len: 0 microversion: 2.1 time: 0.250670 Jun 16 16:18:46.135335 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 355/722] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 16:18:45 2022] DELETE /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee/os-volume_attachments/6bab4f74-d090-4ea0-81f3-db3de0f86612 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:18:46.903731 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4f31434a-7117-459b-a409-d65e7c50e270 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:46.904436 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4f31434a-7117-459b-a409-d65e7c50e270 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:46.918367 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4f31434a-7117-459b-a409-d65e7c50e270 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:46.918904 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4f31434a-7117-459b-a409-d65e7c50e270 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:46.919688 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4f31434a-7117-459b-a409-d65e7c50e270 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:46.920133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4f31434a-7117-459b-a409-d65e7c50e270 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:47.033404 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d9978b1f-a36b-4515-8588-f90b91ecc947 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:47.034301 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d9978b1f-a36b-4515-8588-f90b91ecc947 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:47.040992 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d9978b1f-a36b-4515-8588-f90b91ecc947 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:47.041431 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d9978b1f-a36b-4515-8588-f90b91ecc947 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:47.042530 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d9978b1f-a36b-4515-8588-f90b91ecc947 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:47.042969 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d9978b1f-a36b-4515-8588-f90b91ecc947 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:47.188068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=4 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:47.210452 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=20 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:47.335755 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4f31434a-7117-459b-a409-d65e7c50e270 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:47.341378 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d9978b1f-a36b-4515-8588-f90b91ecc947 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:47.350458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4f31434a-7117-459b-a409-d65e7c50e270 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1363 microversion: 2.1 time: 0.450052 Jun 16 16:18:47.362941 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 368/723] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:46 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1363 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:47.363217 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d9978b1f-a36b-4515-8588-f90b91ecc947 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1556 microversion: 2.1 time: 0.330705 Jun 16 16:18:47.363217 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 356/724] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:47 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1556 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:47.389324 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-62b3204c-3d72-4e1b-a8a5-cc5a635d9c1e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:47.390303 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-62b3204c-3d72-4e1b-a8a5-cc5a635d9c1e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:47.397675 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=4 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:47.416469 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-62b3204c-3d72-4e1b-a8a5-cc5a635d9c1e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:47.417561 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-62b3204c-3d72-4e1b-a8a5-cc5a635d9c1e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:47.418711 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-62b3204c-3d72-4e1b-a8a5-cc5a635d9c1e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:47.419154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-62b3204c-3d72-4e1b-a8a5-cc5a635d9c1e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:47.627342 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-62b3204c-3d72-4e1b-a8a5-cc5a635d9c1e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.248621 Jun 16 16:18:47.628778 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 369/725] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 16:18:47 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-interface => generated 285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:48.381405 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-19d4f06c-afd6-40b5-89db-213861f1f50d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:48.382591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-19d4f06c-afd6-40b5-89db-213861f1f50d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:48.385433 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-26f8e24f-7b31-4135-9d32-39d6e84c91df tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:48.386088 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-26f8e24f-7b31-4135-9d32-39d6e84c91df tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:48.394283 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19d4f06c-afd6-40b5-89db-213861f1f50d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:48.395171 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19d4f06c-afd6-40b5-89db-213861f1f50d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:48.395330 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-26f8e24f-7b31-4135-9d32-39d6e84c91df tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:48.395820 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-26f8e24f-7b31-4135-9d32-39d6e84c91df tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:48.396663 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19d4f06c-afd6-40b5-89db-213861f1f50d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:48.396786 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-26f8e24f-7b31-4135-9d32-39d6e84c91df tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:48.397246 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-26f8e24f-7b31-4135-9d32-39d6e84c91df tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:48.397547 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-19d4f06c-afd6-40b5-89db-213861f1f50d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:48.429422 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-26f8e24f-7b31-4135-9d32-39d6e84c91df tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Going to try to terminate instance {{(pid=117756) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:18:48.540607 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-26f8e24f-7b31-4135-9d32-39d6e84c91df tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 204 len: 0 microversion: 2.1 time: 0.160694 Jun 16 16:18:48.541313 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 370/726] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:18:48 2022] DELETE /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:18:48.552723 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3656dd85-7430-4d83-bbff-ad07e1d499e5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:48.553756 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3656dd85-7430-4d83-bbff-ad07e1d499e5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:48.561436 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3656dd85-7430-4d83-bbff-ad07e1d499e5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:48.562060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3656dd85-7430-4d83-bbff-ad07e1d499e5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:48.562923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3656dd85-7430-4d83-bbff-ad07e1d499e5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:48.563531 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3656dd85-7430-4d83-bbff-ad07e1d499e5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:48.600306 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-19d4f06c-afd6-40b5-89db-213861f1f50d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:48.612386 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-19d4f06c-afd6-40b5-89db-213861f1f50d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1363 microversion: 2.1 time: 0.238894 Jun 16 16:18:48.613342 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 357/727] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:48 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:48.963464 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3656dd85-7430-4d83-bbff-ad07e1d499e5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:48.977326 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3656dd85-7430-4d83-bbff-ad07e1d499e5 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1514 microversion: 2.1 time: 0.430003 Jun 16 16:18:48.978586 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 371/728] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:48 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1514 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:49.634553 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6cc32ef4-d7d0-47a2-a878-54b03321b987 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:49.638042 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6cc32ef4-d7d0-47a2-a878-54b03321b987 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:49.650016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6cc32ef4-d7d0-47a2-a878-54b03321b987 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:49.650724 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6cc32ef4-d7d0-47a2-a878-54b03321b987 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:49.651764 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6cc32ef4-d7d0-47a2-a878-54b03321b987 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:49.652733 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6cc32ef4-d7d0-47a2-a878-54b03321b987 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:49.910800 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6cc32ef4-d7d0-47a2-a878-54b03321b987 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:49.924341 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6cc32ef4-d7d0-47a2-a878-54b03321b987 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1363 microversion: 2.1 time: 0.295126 Jun 16 16:18:49.937995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 358/729] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:49 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:50.009840 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a58af1a1-e422-4dd3-b68c-739f604af19f tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:50.010764 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a58af1a1-e422-4dd3-b68c-739f604af19f tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:50.019890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a58af1a1-e422-4dd3-b68c-739f604af19f tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:50.020644 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a58af1a1-e422-4dd3-b68c-739f604af19f tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:50.021599 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a58af1a1-e422-4dd3-b68c-739f604af19f tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:50.022206 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a58af1a1-e422-4dd3-b68c-739f604af19f tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:50.080464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-e8c37c23-27ab-4432-b37e-ff114d538995 req-cbfa5887-4499-4d5d-8505-43bfac4a38fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a345636a-18e8-47a4-94ae-64363ef57f55", "tag": "090307fe-9628-4c5e-8a8c-15b983b49709"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:50.094825 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-e8c37c23-27ab-4432-b37e-ff114d538995 req-cbfa5887-4499-4d5d-8505-43bfac4a38fa service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:50.095826 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-e8c37c23-27ab-4432-b37e-ff114d538995 req-cbfa5887-4499-4d5d-8505-43bfac4a38fa service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:50.114815 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-e8c37c23-27ab-4432-b37e-ff114d538995 req-cbfa5887-4499-4d5d-8505-43bfac4a38fa service nova] Creating event network-changed:090307fe-9628-4c5e-8a8c-15b983b49709 for instance a345636a-18e8-47a4-94ae-64363ef57f55 on hv-cinder-83716 Jun 16 16:18:50.122947 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-e8c37c23-27ab-4432-b37e-ff114d538995 req-cbfa5887-4499-4d5d-8505-43bfac4a38fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052009 Jun 16 16:18:50.123970 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 359/730] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:50.341196 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a58af1a1-e422-4dd3-b68c-739f604af19f tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:50.354857 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a58af1a1-e422-4dd3-b68c-739f604af19f tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1514 microversion: 2.1 time: 0.353902 Jun 16 16:18:50.367355 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 372/731] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:49 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1514 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:50.947526 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-76c0881a-a312-4c8d-9c2a-fd1cbb4d6c90 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:50.949086 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-76c0881a-a312-4c8d-9c2a-fd1cbb4d6c90 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:50.962901 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-76c0881a-a312-4c8d-9c2a-fd1cbb4d6c90 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:50.963780 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-76c0881a-a312-4c8d-9c2a-fd1cbb4d6c90 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:50.964697 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-76c0881a-a312-4c8d-9c2a-fd1cbb4d6c90 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:50.965356 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-76c0881a-a312-4c8d-9c2a-fd1cbb4d6c90 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:51.303444 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-76c0881a-a312-4c8d-9c2a-fd1cbb4d6c90 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:51.315511 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-76c0881a-a312-4c8d-9c2a-fd1cbb4d6c90 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1363 microversion: 2.1 time: 0.373071 Jun 16 16:18:51.318827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 360/732] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:50 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1363 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:51.376694 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1e0a4425-2d3d-4625-8b75-28373ecdba30 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:51.377788 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1e0a4425-2d3d-4625-8b75-28373ecdba30 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:51.392375 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1e0a4425-2d3d-4625-8b75-28373ecdba30 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:51.393691 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1e0a4425-2d3d-4625-8b75-28373ecdba30 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:51.394968 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1e0a4425-2d3d-4625-8b75-28373ecdba30 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:51.395729 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1e0a4425-2d3d-4625-8b75-28373ecdba30 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:51.856672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1e0a4425-2d3d-4625-8b75-28373ecdba30 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:51.867959 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-a54ea5f4-1b58-43a0-a02c-d6502dbb55f8 req-2f084054-a8bb-47bb-9ef1-7dbbf20d3e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61ad4f5-127e-4836-ad7c-75ae01179424", "name": "network-vif-plugged", "status": "completed", "tag": "345d7505-2303-4cf6-ac18-5979aa4955be"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:51.883241 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-a54ea5f4-1b58-43a0-a02c-d6502dbb55f8 req-2f084054-a8bb-47bb-9ef1-7dbbf20d3e2a service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:51.883943 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-a54ea5f4-1b58-43a0-a02c-d6502dbb55f8 req-2f084054-a8bb-47bb-9ef1-7dbbf20d3e2a service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:51.894172 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1e0a4425-2d3d-4625-8b75-28373ecdba30 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1514 microversion: 2.1 time: 0.523679 Jun 16 16:18:51.902960 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 373/733] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:51 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1514 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:51.921207 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-a54ea5f4-1b58-43a0-a02c-d6502dbb55f8 req-2f084054-a8bb-47bb-9ef1-7dbbf20d3e2a service nova] Creating event network-vif-plugged:345d7505-2303-4cf6-ac18-5979aa4955be for instance d61ad4f5-127e-4836-ad7c-75ae01179424 on hv-cinder-83716 Jun 16 16:18:51.933887 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-a54ea5f4-1b58-43a0-a02c-d6502dbb55f8 req-2f084054-a8bb-47bb-9ef1-7dbbf20d3e2a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069445 Jun 16 16:18:51.934874 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 361/734] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:52.346339 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c7d61a4d-948f-4ec7-ac51-ebe0323153b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:52.347064 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c7d61a4d-948f-4ec7-ac51-ebe0323153b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:52.354091 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c7d61a4d-948f-4ec7-ac51-ebe0323153b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:52.354529 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c7d61a4d-948f-4ec7-ac51-ebe0323153b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:52.355555 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c7d61a4d-948f-4ec7-ac51-ebe0323153b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:52.356772 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c7d61a4d-948f-4ec7-ac51-ebe0323153b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:52.922374 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e5ba6460-6ce2-424d-92ad-65af68bf2ebb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:52.924874 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e5ba6460-6ce2-424d-92ad-65af68bf2ebb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:52.933972 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5ba6460-6ce2-424d-92ad-65af68bf2ebb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:52.934987 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5ba6460-6ce2-424d-92ad-65af68bf2ebb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:52.936248 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5ba6460-6ce2-424d-92ad-65af68bf2ebb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:52.937050 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e5ba6460-6ce2-424d-92ad-65af68bf2ebb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:53.089203 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c7d61a4d-948f-4ec7-ac51-ebe0323153b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:53.106093 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c7d61a4d-948f-4ec7-ac51-ebe0323153b3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1363 microversion: 2.1 time: 0.765019 Jun 16 16:18:53.120227 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 374/735] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:52 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1363 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:53.151162 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e5ba6460-6ce2-424d-92ad-65af68bf2ebb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:53.161469 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e5ba6460-6ce2-424d-92ad-65af68bf2ebb tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1514 microversion: 2.1 time: 0.244745 Jun 16 16:18:53.170849 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 362/736] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:52 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:53.320946 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-6987f0ea-d154-42c1-9dc1-e43510188760 req-35dfcdc4-3db5-43f0-ad7a-2c9324bbe44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dcb1996-2963-4d45-bf74-e753c4ad9eee", "name": "network-vif-deleted", "tag": "024b92d2-158e-4a6e-bef1-45ef59b811b6"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:53.331253 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-6987f0ea-d154-42c1-9dc1-e43510188760 req-35dfcdc4-3db5-43f0-ad7a-2c9324bbe44a service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:53.331785 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-6987f0ea-d154-42c1-9dc1-e43510188760 req-35dfcdc4-3db5-43f0-ad7a-2c9324bbe44a service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:53.345915 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-6987f0ea-d154-42c1-9dc1-e43510188760 req-35dfcdc4-3db5-43f0-ad7a-2c9324bbe44a service nova] Creating event network-vif-deleted:024b92d2-158e-4a6e-bef1-45ef59b811b6 for instance 3dcb1996-2963-4d45-bf74-e753c4ad9eee on hv-cinder-83716 Jun 16 16:18:53.350976 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-6987f0ea-d154-42c1-9dc1-e43510188760 req-35dfcdc4-3db5-43f0-ad7a-2c9324bbe44a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034441 Jun 16 16:18:53.351705 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 375/737] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:54.126044 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6352dee9-8238-42fa-8b95-bb252c3c3510 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:54.127292 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6352dee9-8238-42fa-8b95-bb252c3c3510 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:54.134869 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6352dee9-8238-42fa-8b95-bb252c3c3510 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:54.135470 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6352dee9-8238-42fa-8b95-bb252c3c3510 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:54.136226 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6352dee9-8238-42fa-8b95-bb252c3c3510 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:54.136742 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6352dee9-8238-42fa-8b95-bb252c3c3510 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:54.182161 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-59f1b7c0-8519-4a80-b750-426f0621e79b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:54.183345 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-59f1b7c0-8519-4a80-b750-426f0621e79b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:54.194865 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-59f1b7c0-8519-4a80-b750-426f0621e79b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:54.194865 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-59f1b7c0-8519-4a80-b750-426f0621e79b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:54.194865 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-59f1b7c0-8519-4a80-b750-426f0621e79b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:54.195506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-59f1b7c0-8519-4a80-b750-426f0621e79b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:54.240564 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-59f1b7c0-8519-4a80-b750-426f0621e79b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:54.241056 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-59f1b7c0-8519-4a80-b750-426f0621e79b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:54.242660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-59f1b7c0-8519-4a80-b750-426f0621e79b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lazy-loading 'fault' on Instance uuid 3dcb1996-2963-4d45-bf74-e753c4ad9eee {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:18:54.306493 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-59f1b7c0-8519-4a80-b750-426f0621e79b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff118e281f40435d8a8253ad10a9042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4bbded2b5a4d5fa7760540cfa123f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:54.324581 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-59f1b7c0-8519-4a80-b750-426f0621e79b tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 200 len: 1309 microversion: 2.1 time: 0.145814 Jun 16 16:18:54.324581 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 376/738] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:54 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 1309 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:54.459658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6352dee9-8238-42fa-8b95-bb252c3c3510 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:54.488139 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6352dee9-8238-42fa-8b95-bb252c3c3510 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1363 microversion: 2.1 time: 0.366053 Jun 16 16:18:54.506394 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 363/739] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:54 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1363 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:54.926341 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c0b47818-93d6-4ba6-918d-f54d0430b248 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:54.927444 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c0b47818-93d6-4ba6-918d-f54d0430b248 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:54.934949 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c0b47818-93d6-4ba6-918d-f54d0430b248 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:54.935399 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c0b47818-93d6-4ba6-918d-f54d0430b248 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:54.936173 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c0b47818-93d6-4ba6-918d-f54d0430b248 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:54.936606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c0b47818-93d6-4ba6-918d-f54d0430b248 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:55.054653 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-c0b47818-93d6-4ba6-918d-f54d0430b248 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lazy-loading 'services' on Instance uuid a915f676-f877-4b53-9061-2b6d5216e40f {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:18:55.215736 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c0b47818-93d6-4ba6-918d-f54d0430b248 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-volume_attachments/7b4f4de0-3b6a-4124-b3a0-e627de5db3e3" status: 202 len: 0 microversion: 2.1 time: 0.303176 Jun 16 16:18:55.217586 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 377/740] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 16:18:54 2022] DELETE /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-volume_attachments/7b4f4de0-3b6a-4124-b3a0-e627de5db3e3 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:18:55.245866 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-74846a76-f91f-4b58-972f-4f89964e7035 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:55.247373 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-74846a76-f91f-4b58-972f-4f89964e7035 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:55.276528 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74846a76-f91f-4b58-972f-4f89964e7035 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:55.277177 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74846a76-f91f-4b58-972f-4f89964e7035 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:55.278451 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74846a76-f91f-4b58-972f-4f89964e7035 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:55.278990 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-74846a76-f91f-4b58-972f-4f89964e7035 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:55.318449 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-74846a76-f91f-4b58-972f-4f89964e7035 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091354 Jun 16 16:18:55.319052 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 364/741] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:18:55 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:18:55.349350 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e9351374-2124-46f7-8827-99b750e8bb93 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:55.351264 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e9351374-2124-46f7-8827-99b750e8bb93 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] [instance: 3dcb1996-2963-4d45-bf74-e753c4ad9eee] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:55.363710 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e9351374-2124-46f7-8827-99b750e8bb93 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:55.364528 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e9351374-2124-46f7-8827-99b750e8bb93 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:55.365349 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e9351374-2124-46f7-8827-99b750e8bb93 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:55.366117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e9351374-2124-46f7-8827-99b750e8bb93 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:55.385596 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-e9351374-2124-46f7-8827-99b750e8bb93 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] HTTP exception thrown: Instance 3dcb1996-2963-4d45-bf74-e753c4ad9eee could not be found. Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e9351374-2124-46f7-8827-99b750e8bb93 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Request method failure captured: Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee HTTP/1.1 Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1dzaQfK2IeIvhC5pryi0sFoDpsZtCBDniyHsqexdq0rJL4iWsKpxVirVkXvv5sg0bfdbIkdenyNONAsABU9S7FOOZ9J1Pf9kTcx9sSx_HkNj4kdcCNfrkLbvug6mEb1AdEtQLRHKepJIDCBZvsxQ5pMJBLUlgnwTsGlvmgq_VzoZbQ Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: cb4bbded2b5a4d5fa7760540cfa123f7 Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1621764165 Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:18:55.387890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:18:55.389750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cb4bbded2b5a4d5fa7760540cfa123f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb4bbded2b5a4d5fa7760540cfa123f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cb4bbded2b5a4d5fa7760540cfa123f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb4bbded2b5a4d5fa7760540cfa123f7"}]}] Jun 16 16:18:55.389750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-VolumesSnapshotTestJSON-1621764165 Jun 16 16:18:55.389750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: cb4bbded2b5a4d5fa7760540cfa123f7 Jun 16 16:18:55.389750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1621764165 Jun 16 16:18:55.389750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-VolumesSnapshotTestJSON-1621764165-project Jun 16 16:18:55.389750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:18:55.389750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:18:55.389750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: ff118e281f40435d8a8253ad10a9042f Jun 16 16:18:55.389750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-VolumesSnapshotTestJSON-1621764165-project Jun 16 16:18:55.389750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:18:55.389750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance 3dcb1996-2963-4d45-bf74-e753c4ad9eee could not be found. Jun 16 16:18:55.389750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': '3dcb1996-2963-4d45-bf74-e753c4ad9eee'} Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dcb1996-2963-4d45-bf74-e753c4ad9eee could not be found. Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:18:55.391277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dcb1996-2963-4d45-bf74-e753c4ad9eee could not be found. Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dcb1996-2963-4d45-bf74-e753c4ad9eee could not be found. Jun 16 16:18:55.394682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:18:55.397463 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e9351374-2124-46f7-8827-99b750e8bb93 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] Returning 404 to user: Instance 3dcb1996-2963-4d45-bf74-e753c4ad9eee could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:18:55.398751 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e9351374-2124-46f7-8827-99b750e8bb93 tempest-VolumesSnapshotTestJSON-1621764165 tempest-VolumesSnapshotTestJSON-1621764165-project] 10.222.0.17 "GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee" status: 404 len: 111 microversion: 2.1 time: 0.056786 Jun 16 16:18:55.403083 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 378/742] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:55 2022] GET /compute/v2.1/servers/3dcb1996-2963-4d45-bf74-e753c4ad9eee => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:18:55.527781 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-02712458-ece3-4f72-85d0-293191c7228b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:55.528968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-02712458-ece3-4f72-85d0-293191c7228b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:55.540785 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-02712458-ece3-4f72-85d0-293191c7228b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:55.541995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-02712458-ece3-4f72-85d0-293191c7228b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:55.543234 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-02712458-ece3-4f72-85d0-293191c7228b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:55.543943 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-02712458-ece3-4f72-85d0-293191c7228b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:55.876137 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-02712458-ece3-4f72-85d0-293191c7228b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:55.909874 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-02712458-ece3-4f72-85d0-293191c7228b tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1549 microversion: 2.1 time: 0.393537 Jun 16 16:18:55.910520 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 365/743] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:55 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1549 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:55.959377 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7a5ee36c-4e72-484b-84d9-7f4150099478 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:55.960350 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7a5ee36c-4e72-484b-84d9-7f4150099478 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:55.978617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7a5ee36c-4e72-484b-84d9-7f4150099478 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:55.979498 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7a5ee36c-4e72-484b-84d9-7f4150099478 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:55.981188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7a5ee36c-4e72-484b-84d9-7f4150099478 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:55.982293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7a5ee36c-4e72-484b-84d9-7f4150099478 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:55.991631 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:56.136766 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7a5ee36c-4e72-484b-84d9-7f4150099478 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200332 Jun 16 16:18:56.137361 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 379/744] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 16:18:55 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:56.341209 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3d6184f5-36d0-4a81-be95-a59c4e8bcf75 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:56.344550 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3d6184f5-36d0-4a81-be95-a59c4e8bcf75 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:56.356588 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d6184f5-36d0-4a81-be95-a59c4e8bcf75 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:56.357715 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d6184f5-36d0-4a81-be95-a59c4e8bcf75 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:56.359427 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d6184f5-36d0-4a81-be95-a59c4e8bcf75 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:56.361708 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d6184f5-36d0-4a81-be95-a59c4e8bcf75 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:56.372076 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:56.433710 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3d6184f5-36d0-4a81-be95-a59c4e8bcf75 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104105 Jun 16 16:18:56.435255 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 366/745] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:18:56 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:57.452082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c3ecf91f-b83e-453e-ac10-326d26358b2f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:57.457482 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c3ecf91f-b83e-453e-ac10-326d26358b2f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:57.466583 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c3ecf91f-b83e-453e-ac10-326d26358b2f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:57.476258 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c3ecf91f-b83e-453e-ac10-326d26358b2f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:57.477662 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c3ecf91f-b83e-453e-ac10-326d26358b2f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:57.478685 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c3ecf91f-b83e-453e-ac10-326d26358b2f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:57.545093 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c3ecf91f-b83e-453e-ac10-326d26358b2f tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097466 Jun 16 16:18:57.546435 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 380/746] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:18:57 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:18:57.670215 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-35ddc945-07c8-4db1-8048-91c36f74d356 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:57.674445 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-35ddc945-07c8-4db1-8048-91c36f74d356 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:57.682717 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35ddc945-07c8-4db1-8048-91c36f74d356 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:57.683319 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35ddc945-07c8-4db1-8048-91c36f74d356 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:57.684210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35ddc945-07c8-4db1-8048-91c36f74d356 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:57.684751 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35ddc945-07c8-4db1-8048-91c36f74d356 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:57.714954 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-35ddc945-07c8-4db1-8048-91c36f74d356 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:18:57.810625 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:57.833389 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-35ddc945-07c8-4db1-8048-91c36f74d356 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 204 len: 0 microversion: 2.1 time: 0.170863 Jun 16 16:18:57.834504 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 367/747] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:18:57 2022] DELETE /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:18:57.845892 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-99b00fd3-58ef-4534-b76f-f1ced11d2c59 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:57.846878 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-99b00fd3-58ef-4534-b76f-f1ced11d2c59 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:57.858965 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-99b00fd3-58ef-4534-b76f-f1ced11d2c59 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:57.862167 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-99b00fd3-58ef-4534-b76f-f1ced11d2c59 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:57.863524 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-99b00fd3-58ef-4534-b76f-f1ced11d2c59 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:57.864184 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-99b00fd3-58ef-4534-b76f-f1ced11d2c59 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:58.057046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-d5cdf005-1531-49f4-8393-4252e1d4b30f req-98d74ea9-0f3b-480d-8f21-11a5a063fa7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61ad4f5-127e-4836-ad7c-75ae01179424", "tag": "345d7505-2303-4cf6-ac18-5979aa4955be"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:58.069409 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-d5cdf005-1531-49f4-8393-4252e1d4b30f req-98d74ea9-0f3b-480d-8f21-11a5a063fa7a service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:58.069911 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-d5cdf005-1531-49f4-8393-4252e1d4b30f req-98d74ea9-0f3b-480d-8f21-11a5a063fa7a service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:58.088907 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-d5cdf005-1531-49f4-8393-4252e1d4b30f req-98d74ea9-0f3b-480d-8f21-11a5a063fa7a service nova] Creating event network-changed:345d7505-2303-4cf6-ac18-5979aa4955be for instance d61ad4f5-127e-4836-ad7c-75ae01179424 on hv-cinder-83716 Jun 16 16:18:58.097902 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-d5cdf005-1531-49f4-8393-4252e1d4b30f req-98d74ea9-0f3b-480d-8f21-11a5a063fa7a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047480 Jun 16 16:18:58.099620 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 368/748] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:18:58.170042 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-99b00fd3-58ef-4534-b76f-f1ced11d2c59 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:58.185639 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-99b00fd3-58ef-4534-b76f-f1ced11d2c59 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1690 microversion: 2.1 time: 0.344536 Jun 16 16:18:58.197329 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 381/749] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:57 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1690 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:59.206164 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d9824520-7ce7-4561-a538-b73ae6b9d80e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:59.207071 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d9824520-7ce7-4561-a538-b73ae6b9d80e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:59.214791 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d9824520-7ce7-4561-a538-b73ae6b9d80e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:59.215101 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d9824520-7ce7-4561-a538-b73ae6b9d80e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:59.216248 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d9824520-7ce7-4561-a538-b73ae6b9d80e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:59.216567 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d9824520-7ce7-4561-a538-b73ae6b9d80e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:59.397913 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d9824520-7ce7-4561-a538-b73ae6b9d80e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:59.406528 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d9824520-7ce7-4561-a538-b73ae6b9d80e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1690 microversion: 2.1 time: 0.205927 Jun 16 16:18:59.407127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 369/750] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:59 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1690 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:00.433199 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-12ba6cdc-1270-4529-87fd-1f3ccc9b195c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:00.434008 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-12ba6cdc-1270-4529-87fd-1f3ccc9b195c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:00.441952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-12ba6cdc-1270-4529-87fd-1f3ccc9b195c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:00.442412 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-12ba6cdc-1270-4529-87fd-1f3ccc9b195c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:00.443304 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-12ba6cdc-1270-4529-87fd-1f3ccc9b195c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:00.443756 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-12ba6cdc-1270-4529-87fd-1f3ccc9b195c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:00.616755 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-12ba6cdc-1270-4529-87fd-1f3ccc9b195c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:00.625525 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-12ba6cdc-1270-4529-87fd-1f3ccc9b195c tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1690 microversion: 2.1 time: 0.196490 Jun 16 16:19:00.626193 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 382/751] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:00 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1690 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:01.645561 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-66e44bec-8ab3-47d3-823b-501220639cbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:01.646394 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-66e44bec-8ab3-47d3-823b-501220639cbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:01.654643 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-66e44bec-8ab3-47d3-823b-501220639cbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:01.655485 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-66e44bec-8ab3-47d3-823b-501220639cbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:01.656503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-66e44bec-8ab3-47d3-823b-501220639cbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:01.657233 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-66e44bec-8ab3-47d3-823b-501220639cbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:01.848800 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-66e44bec-8ab3-47d3-823b-501220639cbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:01.856835 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-66e44bec-8ab3-47d3-823b-501220639cbc tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1690 microversion: 2.1 time: 0.216408 Jun 16 16:19:01.857418 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 370/752] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:01 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1690 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:02.877582 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-cd1ef332-8f52-45b8-bc7c-1ea822458ab4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:02.878402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-cd1ef332-8f52-45b8-bc7c-1ea822458ab4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:02.893854 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cd1ef332-8f52-45b8-bc7c-1ea822458ab4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:02.895438 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cd1ef332-8f52-45b8-bc7c-1ea822458ab4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:02.895956 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cd1ef332-8f52-45b8-bc7c-1ea822458ab4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:02.896595 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cd1ef332-8f52-45b8-bc7c-1ea822458ab4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:03.072799 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-cd1ef332-8f52-45b8-bc7c-1ea822458ab4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:03.080755 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-cd1ef332-8f52-45b8-bc7c-1ea822458ab4 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1690 microversion: 2.1 time: 0.208750 Jun 16 16:19:03.081339 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 383/753] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:02 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1690 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:04.099023 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-65e8b712-be34-40b7-8c11-edb8f6c826ab tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:04.099848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-65e8b712-be34-40b7-8c11-edb8f6c826ab tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:04.112865 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-65e8b712-be34-40b7-8c11-edb8f6c826ab tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:04.113454 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-65e8b712-be34-40b7-8c11-edb8f6c826ab tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:04.114457 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-65e8b712-be34-40b7-8c11-edb8f6c826ab tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:04.114945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-65e8b712-be34-40b7-8c11-edb8f6c826ab tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:04.292187 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-65e8b712-be34-40b7-8c11-edb8f6c826ab tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:04.303563 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-65e8b712-be34-40b7-8c11-edb8f6c826ab tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1690 microversion: 2.1 time: 0.208848 Jun 16 16:19:04.304190 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 371/754] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:04 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1690 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:05.321604 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-9a31733d-925e-4b13-b181-f4331c7623e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:05.322254 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-9a31733d-925e-4b13-b181-f4331c7623e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:05.324758 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:05.330793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9a31733d-925e-4b13-b181-f4331c7623e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:05.331329 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9a31733d-925e-4b13-b181-f4331c7623e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:05.332118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9a31733d-925e-4b13-b181-f4331c7623e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:05.332550 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9a31733d-925e-4b13-b181-f4331c7623e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:05.661667 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-9a31733d-925e-4b13-b181-f4331c7623e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:05.669210 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-9a31733d-925e-4b13-b181-f4331c7623e5 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1690 microversion: 2.1 time: 0.352035 Jun 16 16:19:05.669895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 384/755] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:05 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1690 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:06.691792 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b34e92bb-2e07-425d-927c-b34089506e29 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:06.692593 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b34e92bb-2e07-425d-927c-b34089506e29 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:06.701054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-8f9e3b91-a0f5-4ec0-add7-e4ca50772f1d req-c84dcfe8-9485-467d-9677-c7f3570fe829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a915f676-f877-4b53-9061-2b6d5216e40f", "name": "network-vif-deleted", "tag": "3a209b58-0eab-4734-8530-5197ed6024ff"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:06.705146 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b34e92bb-2e07-425d-927c-b34089506e29 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:06.705687 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b34e92bb-2e07-425d-927c-b34089506e29 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:06.706577 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b34e92bb-2e07-425d-927c-b34089506e29 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:06.707027 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b34e92bb-2e07-425d-927c-b34089506e29 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:06.712741 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-8f9e3b91-a0f5-4ec0-add7-e4ca50772f1d req-c84dcfe8-9485-467d-9677-c7f3570fe829 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:06.713513 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-8f9e3b91-a0f5-4ec0-add7-e4ca50772f1d req-c84dcfe8-9485-467d-9677-c7f3570fe829 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:06.732195 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-8f9e3b91-a0f5-4ec0-add7-e4ca50772f1d req-c84dcfe8-9485-467d-9677-c7f3570fe829 service nova] Creating event network-vif-deleted:3a209b58-0eab-4734-8530-5197ed6024ff for instance a915f676-f877-4b53-9061-2b6d5216e40f on hv-cinder-83716 Jun 16 16:19:06.744413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-8f9e3b91-a0f5-4ec0-add7-e4ca50772f1d req-c84dcfe8-9485-467d-9677-c7f3570fe829 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047385 Jun 16 16:19:06.745490 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 385/756] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:19:06.793501 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b34e92bb-2e07-425d-927c-b34089506e29 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:06.809797 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b34e92bb-2e07-425d-927c-b34089506e29 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1622 microversion: 2.1 time: 0.124534 Jun 16 16:19:06.811137 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 372/757] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:06 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1622 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:07.838065 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-cb772778-fda2-4375-8a58-1b21666665bf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:07.838809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-cb772778-fda2-4375-8a58-1b21666665bf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:07.845638 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cb772778-fda2-4375-8a58-1b21666665bf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:07.846156 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cb772778-fda2-4375-8a58-1b21666665bf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:07.847049 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cb772778-fda2-4375-8a58-1b21666665bf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:07.847495 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cb772778-fda2-4375-8a58-1b21666665bf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:07.946274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-cb772778-fda2-4375-8a58-1b21666665bf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:07.956383 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-cb772778-fda2-4375-8a58-1b21666665bf tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1331 microversion: 2.1 time: 0.123064 Jun 16 16:19:07.956991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 386/758] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:07 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:08.977101 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a1d2582d-33c6-4501-8488-a61360b593de tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:08.978191 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a1d2582d-33c6-4501-8488-a61360b593de tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:08.987457 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a1d2582d-33c6-4501-8488-a61360b593de tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:08.988028 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a1d2582d-33c6-4501-8488-a61360b593de tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:08.988905 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a1d2582d-33c6-4501-8488-a61360b593de tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:08.989435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a1d2582d-33c6-4501-8488-a61360b593de tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:09.067673 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a1d2582d-33c6-4501-8488-a61360b593de tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:09.080036 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a1d2582d-33c6-4501-8488-a61360b593de tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 200 len: 1331 microversion: 2.1 time: 0.107263 Jun 16 16:19:09.081566 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 373/759] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:08 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:10.101152 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8561b8db-59d0-4214-a0ff-bd1d84820ea6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:10.101836 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8561b8db-59d0-4214-a0ff-bd1d84820ea6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: a915f676-f877-4b53-9061-2b6d5216e40f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:10.108967 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8561b8db-59d0-4214-a0ff-bd1d84820ea6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:10.109421 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8561b8db-59d0-4214-a0ff-bd1d84820ea6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:10.111020 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8561b8db-59d0-4214-a0ff-bd1d84820ea6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:10.112041 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8561b8db-59d0-4214-a0ff-bd1d84820ea6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:10.130071 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-8561b8db-59d0-4214-a0ff-bd1d84820ea6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] HTTP exception thrown: Instance a915f676-f877-4b53-9061-2b6d5216e40f could not be found. Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8561b8db-59d0-4214-a0ff-bd1d84820ea6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Request method failure captured: Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f HTTP/1.1 Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ZJY_sf7_CaFp_lO20gYVdqLWXD7KbXNclHWQjc7pFk6nrkQF5CUv-8fhFY_sEa4Cuuwxdq5-z1gFim5Qvs5jD5K3YfctWCEQ53zozYHt_RA-tZlOmWWY7ue5LMWv7eCUbS2DS_i_lm-rWoECV8WYU-ge_gZY1PlPBE00XcuxlXLh4 Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 6eee49063a5847dba6ffb520d0149d88 Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-14364702 Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:19:10.132559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:19:10.134606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6eee49063a5847dba6ffb520d0149d88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6eee49063a5847dba6ffb520d0149d88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6eee49063a5847dba6ffb520d0149d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6eee49063a5847dba6ffb520d0149d88"}]}] Jun 16 16:19:10.134606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-ServerRescueNegativeTestJSON-14364702 Jun 16 16:19:10.134606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 6eee49063a5847dba6ffb520d0149d88 Jun 16 16:19:10.134606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-14364702 Jun 16 16:19:10.134606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-ServerRescueNegativeTestJSON-14364702-project Jun 16 16:19:10.134606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:19:10.134606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:19:10.134606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 515114f0a842463fb2d1265ee33db8eb Jun 16 16:19:10.134606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-ServerRescueNegativeTestJSON-14364702-project Jun 16 16:19:10.134606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:19:10.134606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance a915f676-f877-4b53-9061-2b6d5216e40f could not be found. Jun 16 16:19:10.134606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': 'a915f676-f877-4b53-9061-2b6d5216e40f'} Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a915f676-f877-4b53-9061-2b6d5216e40f could not be found. Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:19:10.135669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a915f676-f877-4b53-9061-2b6d5216e40f could not be found. Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a915f676-f877-4b53-9061-2b6d5216e40f could not be found. Jun 16 16:19:10.137164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:10.138639 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8561b8db-59d0-4214-a0ff-bd1d84820ea6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Returning 404 to user: Instance a915f676-f877-4b53-9061-2b6d5216e40f could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:19:10.138639 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8561b8db-59d0-4214-a0ff-bd1d84820ea6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f" status: 404 len: 111 microversion: 2.1 time: 0.037078 Jun 16 16:19:10.138639 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 387/760] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:10 2022] GET /compute/v2.1/servers/a915f676-f877-4b53-9061-2b6d5216e40f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:19:10.143261 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2046f261-1d6d-4091-9fa5-3e21ca83b500 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '.version_select at 0x7f38bb433940>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:10.161001 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2046f261-1d6d-4091-9fa5-3e21ca83b500 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920817915" status: 202 len: 0 microversion: 2.1 time: 0.021804 Jun 16 16:19:10.161585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 374/761] 10.222.0.17 () {58 vars in 1220 bytes} [Thu Jun 16 16:19:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920817915 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:19:13.200683 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-776a1a61-35f1-47b4-aac3-2eebac4c4921 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:13.201360 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-776a1a61-35f1-47b4-aac3-2eebac4c4921 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:13.208132 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-776a1a61-35f1-47b4-aac3-2eebac4c4921 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:13.208596 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-776a1a61-35f1-47b4-aac3-2eebac4c4921 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:13.209342 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-776a1a61-35f1-47b4-aac3-2eebac4c4921 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:13.209774 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-776a1a61-35f1-47b4-aac3-2eebac4c4921 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:13.235578 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-776a1a61-35f1-47b4-aac3-2eebac4c4921 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Going to try to terminate instance {{(pid=117756) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:19:13.329833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-776a1a61-35f1-47b4-aac3-2eebac4c4921 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 204 len: 0 microversion: 2.1 time: 0.132718 Jun 16 16:19:13.330614 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 388/762] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:19:13 2022] DELETE /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:19:13.340761 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-65da9561-dd89-4f1c-9756-e77a25729ac1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:13.341569 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-65da9561-dd89-4f1c-9756-e77a25729ac1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:13.353820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-65da9561-dd89-4f1c-9756-e77a25729ac1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:13.354723 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-65da9561-dd89-4f1c-9756-e77a25729ac1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:13.355681 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-65da9561-dd89-4f1c-9756-e77a25729ac1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:13.356182 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-65da9561-dd89-4f1c-9756-e77a25729ac1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:13.518692 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-65da9561-dd89-4f1c-9756-e77a25729ac1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:13.526818 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-65da9561-dd89-4f1c-9756-e77a25729ac1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1508 microversion: 2.1 time: 0.190804 Jun 16 16:19:13.527413 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 375/763] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:13 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:14.546862 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-f3d44222-5b07-40a2-902a-aff9063b037d req-46152282-0778-4b1d-9fd3-d72242e02278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5", "name": "network-vif-deleted", "tag": "ecd1c4fc-716d-40aa-81c3-83ee9f284517"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:14.551006 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-35611001-96b3-4f13-a8cf-f302db1ac823 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:14.552918 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-35611001-96b3-4f13-a8cf-f302db1ac823 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:14.558438 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-f3d44222-5b07-40a2-902a-aff9063b037d req-46152282-0778-4b1d-9fd3-d72242e02278 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:14.558898 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-f3d44222-5b07-40a2-902a-aff9063b037d req-46152282-0778-4b1d-9fd3-d72242e02278 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:14.571537 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35611001-96b3-4f13-a8cf-f302db1ac823 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:14.572691 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35611001-96b3-4f13-a8cf-f302db1ac823 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:14.572936 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-f3d44222-5b07-40a2-902a-aff9063b037d req-46152282-0778-4b1d-9fd3-d72242e02278 service nova] Creating event network-vif-deleted:ecd1c4fc-716d-40aa-81c3-83ee9f284517 for instance fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 on hv-cinder-83716 Jun 16 16:19:14.573842 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35611001-96b3-4f13-a8cf-f302db1ac823 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:14.574786 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35611001-96b3-4f13-a8cf-f302db1ac823 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:14.580805 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-f3d44222-5b07-40a2-902a-aff9063b037d req-46152282-0778-4b1d-9fd3-d72242e02278 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039991 Jun 16 16:19:14.581763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 389/764] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:14.679924 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-35611001-96b3-4f13-a8cf-f302db1ac823 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:14.693091 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-35611001-96b3-4f13-a8cf-f302db1ac823 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 200 len: 1293 microversion: 2.1 time: 0.148762 Jun 16 16:19:14.694023 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 376/765] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:14 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 1293 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:15.712169 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f30011ef-a6e2-46dc-8c64-a8e1cc9ce582 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:15.712914 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f30011ef-a6e2-46dc-8c64-a8e1cc9ce582 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:15.720239 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f30011ef-a6e2-46dc-8c64-a8e1cc9ce582 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:15.720735 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f30011ef-a6e2-46dc-8c64-a8e1cc9ce582 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:15.721565 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f30011ef-a6e2-46dc-8c64-a8e1cc9ce582 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:15.722122 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f30011ef-a6e2-46dc-8c64-a8e1cc9ce582 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:15.736775 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-f30011ef-a6e2-46dc-8c64-a8e1cc9ce582 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] HTTP exception thrown: Instance fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 could not be found. Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f30011ef-a6e2-46dc-8c64-a8e1cc9ce582 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Request method failure captured: Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 HTTP/1.1 Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ZJY_sf7_CaFp_lO20gYVdqLWXD7KbXNclHWQjc7pFk6nrkQF5CUv-8fhFY_sEa4Cuuwxdq5-z1gFim5Qvs5jD5K3YfctWCEQ53zozYHt_RA-tZlOmWWY7ue5LMWv7eCUbS2DS_i_lm-rWoECV8WYU-ge_gZY1PlPBE00XcuxlXLh4 Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 6eee49063a5847dba6ffb520d0149d88 Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-14364702 Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:19:15.738509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:19:15.740082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6eee49063a5847dba6ffb520d0149d88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6eee49063a5847dba6ffb520d0149d88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6eee49063a5847dba6ffb520d0149d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6eee49063a5847dba6ffb520d0149d88"}]}] Jun 16 16:19:15.740082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-ServerRescueNegativeTestJSON-14364702 Jun 16 16:19:15.740082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 6eee49063a5847dba6ffb520d0149d88 Jun 16 16:19:15.740082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-14364702 Jun 16 16:19:15.740082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-ServerRescueNegativeTestJSON-14364702-project Jun 16 16:19:15.740082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:19:15.740082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:19:15.740082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 515114f0a842463fb2d1265ee33db8eb Jun 16 16:19:15.740082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-ServerRescueNegativeTestJSON-14364702-project Jun 16 16:19:15.740082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:19:15.740082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 could not be found. Jun 16 16:19:15.740082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': 'fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5'} Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 could not be found. Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:19:15.740809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 could not be found. Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 could not be found. Jun 16 16:19:15.742462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:15.743742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f30011ef-a6e2-46dc-8c64-a8e1cc9ce582 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Returning 404 to user: Instance fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:19:15.743742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f30011ef-a6e2-46dc-8c64-a8e1cc9ce582 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5" status: 404 len: 111 microversion: 2.1 time: 0.032578 Jun 16 16:19:15.743742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 390/766] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:15 2022] GET /compute/v2.1/servers/fc75b3e5-513a-4ffc-9fb5-d5f87522ecd5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:19:15.750067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ba66f7ee-8245-404d-ba58-9bf8c5a47ba6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:15.750879 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ba66f7ee-8245-404d-ba58-9bf8c5a47ba6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:15.759220 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ba66f7ee-8245-404d-ba58-9bf8c5a47ba6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:15.759658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ba66f7ee-8245-404d-ba58-9bf8c5a47ba6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:15.760556 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ba66f7ee-8245-404d-ba58-9bf8c5a47ba6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:15.761383 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ba66f7ee-8245-404d-ba58-9bf8c5a47ba6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:15.789631 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ba66f7ee-8245-404d-ba58-9bf8c5a47ba6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:19:15.874936 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ba66f7ee-8245-404d-ba58-9bf8c5a47ba6 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "DELETE /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 204 len: 0 microversion: 2.1 time: 0.128122 Jun 16 16:19:15.876498 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 377/767] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:19:15 2022] DELETE /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:19:15.888049 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-061b5497-04a0-4ff1-a991-513ea13d56b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:15.888769 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-061b5497-04a0-4ff1-a991-513ea13d56b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:15.895956 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-061b5497-04a0-4ff1-a991-513ea13d56b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:15.896413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-061b5497-04a0-4ff1-a991-513ea13d56b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:15.897199 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-061b5497-04a0-4ff1-a991-513ea13d56b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:15.897680 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-061b5497-04a0-4ff1-a991-513ea13d56b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:16.059787 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-061b5497-04a0-4ff1-a991-513ea13d56b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:16.069586 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-061b5497-04a0-4ff1-a991-513ea13d56b1 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.186158 Jun 16 16:19:16.070390 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 391/768] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:15 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:17.090180 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9303a678-29b1-4c89-b31d-cc9780422a1b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:17.090897 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9303a678-29b1-4c89-b31d-cc9780422a1b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:17.097796 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9303a678-29b1-4c89-b31d-cc9780422a1b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:17.098417 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9303a678-29b1-4c89-b31d-cc9780422a1b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:17.099199 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9303a678-29b1-4c89-b31d-cc9780422a1b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:17.099638 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9303a678-29b1-4c89-b31d-cc9780422a1b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:17.259956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9303a678-29b1-4c89-b31d-cc9780422a1b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:17.268656 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9303a678-29b1-4c89-b31d-cc9780422a1b tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.183149 Jun 16 16:19:17.269534 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 378/769] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:17 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:18.286259 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b011bcd2-063e-47be-b747-cb2a014ac341 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:18.287156 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b011bcd2-063e-47be-b747-cb2a014ac341 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:18.294429 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b011bcd2-063e-47be-b747-cb2a014ac341 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:18.294998 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b011bcd2-063e-47be-b747-cb2a014ac341 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:18.295826 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b011bcd2-063e-47be-b747-cb2a014ac341 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:18.296298 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b011bcd2-063e-47be-b747-cb2a014ac341 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:18.469363 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b011bcd2-063e-47be-b747-cb2a014ac341 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:18.478262 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b011bcd2-063e-47be-b747-cb2a014ac341 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1520 microversion: 2.1 time: 0.196267 Jun 16 16:19:18.478855 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 392/770] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:18 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:19.489248 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-689bfc63-f852-4ff2-a348-538cf8f3e53e req-5cd90a98-73c7-4368-8d4f-b7a1245fb8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83df7777-6291-4644-a893-e1359c012b9f", "name": "network-vif-deleted", "tag": "4a474085-3880-4331-a44c-eaa67f0578be"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:19.499414 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-689bfc63-f852-4ff2-a348-538cf8f3e53e req-5cd90a98-73c7-4368-8d4f-b7a1245fb8f3 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:19.499849 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-689bfc63-f852-4ff2-a348-538cf8f3e53e req-5cd90a98-73c7-4368-8d4f-b7a1245fb8f3 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:19.501818 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7a1f7b20-7c4a-4cae-b12e-e69605e4807e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:19.503304 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7a1f7b20-7c4a-4cae-b12e-e69605e4807e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:19.511375 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7a1f7b20-7c4a-4cae-b12e-e69605e4807e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:19.511827 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7a1f7b20-7c4a-4cae-b12e-e69605e4807e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:19.512609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7a1f7b20-7c4a-4cae-b12e-e69605e4807e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:19.513041 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7a1f7b20-7c4a-4cae-b12e-e69605e4807e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:19.524689 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-689bfc63-f852-4ff2-a348-538cf8f3e53e req-5cd90a98-73c7-4368-8d4f-b7a1245fb8f3 service nova] Creating event network-vif-deleted:4a474085-3880-4331-a44c-eaa67f0578be for instance 83df7777-6291-4644-a893-e1359c012b9f on hv-cinder-83716 Jun 16 16:19:19.530216 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-689bfc63-f852-4ff2-a348-538cf8f3e53e req-5cd90a98-73c7-4368-8d4f-b7a1245fb8f3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045650 Jun 16 16:19:19.531205 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 379/771] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:19.601568 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7a1f7b20-7c4a-4cae-b12e-e69605e4807e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515114f0a842463fb2d1265ee33db8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eee49063a5847dba6ffb520d0149d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:19.614329 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7a1f7b20-7c4a-4cae-b12e-e69605e4807e tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 200 len: 1305 microversion: 2.1 time: 0.118931 Jun 16 16:19:19.614929 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 393/772] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:19 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 1305 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:20.634092 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-934fcd24-ae88-4413-ad01-e37df138e5c0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:20.634854 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-934fcd24-ae88-4413-ad01-e37df138e5c0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] [instance: 83df7777-6291-4644-a893-e1359c012b9f] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:20.642435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-934fcd24-ae88-4413-ad01-e37df138e5c0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:20.642883 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-934fcd24-ae88-4413-ad01-e37df138e5c0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:20.643915 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-934fcd24-ae88-4413-ad01-e37df138e5c0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:20.644407 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-934fcd24-ae88-4413-ad01-e37df138e5c0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:20.660213 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-934fcd24-ae88-4413-ad01-e37df138e5c0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] HTTP exception thrown: Instance 83df7777-6291-4644-a893-e1359c012b9f could not be found. Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-934fcd24-ae88-4413-ad01-e37df138e5c0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Request method failure captured: Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f HTTP/1.1 Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ZJY_sf7_CaFp_lO20gYVdqLWXD7KbXNclHWQjc7pFk6nrkQF5CUv-8fhFY_sEa4Cuuwxdq5-z1gFim5Qvs5jD5K3YfctWCEQ53zozYHt_RA-tZlOmWWY7ue5LMWv7eCUbS2DS_i_lm-rWoECV8WYU-ge_gZY1PlPBE00XcuxlXLh4 Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 6eee49063a5847dba6ffb520d0149d88 Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-14364702 Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:19:20.662263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:19:20.663827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6eee49063a5847dba6ffb520d0149d88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6eee49063a5847dba6ffb520d0149d88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6eee49063a5847dba6ffb520d0149d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6eee49063a5847dba6ffb520d0149d88"}]}] Jun 16 16:19:20.663827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-ServerRescueNegativeTestJSON-14364702 Jun 16 16:19:20.663827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 6eee49063a5847dba6ffb520d0149d88 Jun 16 16:19:20.663827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-14364702 Jun 16 16:19:20.663827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-ServerRescueNegativeTestJSON-14364702-project Jun 16 16:19:20.663827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:19:20.663827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:19:20.663827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 515114f0a842463fb2d1265ee33db8eb Jun 16 16:19:20.663827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-ServerRescueNegativeTestJSON-14364702-project Jun 16 16:19:20.663827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:19:20.663827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance 83df7777-6291-4644-a893-e1359c012b9f could not be found. Jun 16 16:19:20.663827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': '83df7777-6291-4644-a893-e1359c012b9f'} Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83df7777-6291-4644-a893-e1359c012b9f could not be found. Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:19:20.664682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83df7777-6291-4644-a893-e1359c012b9f could not be found. Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83df7777-6291-4644-a893-e1359c012b9f could not be found. Jun 16 16:19:20.666094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:19:20.667465 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-934fcd24-ae88-4413-ad01-e37df138e5c0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] Returning 404 to user: Instance 83df7777-6291-4644-a893-e1359c012b9f could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:19:20.667465 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-934fcd24-ae88-4413-ad01-e37df138e5c0 tempest-ServerRescueNegativeTestJSON-14364702 tempest-ServerRescueNegativeTestJSON-14364702-project] 10.222.0.17 "GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f" status: 404 len: 111 microversion: 2.1 time: 0.036013 Jun 16 16:19:20.667465 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 380/773] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:20 2022] GET /compute/v2.1/servers/83df7777-6291-4644-a893-e1359c012b9f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:19:31.008075 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:31.009339 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:31.184676 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-af58ca2b-90e6-497d-a139-55a481d1dd54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Action: 'create', calling method: .version_select at 0x7f38bb6dd670>, body: {"keypair": {"name": "tempest-keypair-1453247066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMqeI/qwLC58U+ZXVNY7rRBStDCnfTn0TXfIMNOMdX6DD7Zcaqpqqu5yMW4S7mrsq0DjTtSKu9rXATZW2xHpoK5jNvtYn/E9ynfCoYYF95E4XFpVjwz3CeoHxnxNk6afw=="}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:31.201161 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-af58ca2b-90e6-497d-a139-55a481d1dd54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Getting quotas for project 5411e6d1c7a94aeeaaa8a0a30fb4887b. Resources: {'key_pairs'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:19:31.207542 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-af58ca2b-90e6-497d-a139-55a481d1dd54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Getting quotas for user 2b32b74cc1e44ce5a7e687e3c04e8099 and project 5411e6d1c7a94aeeaaa8a0a30fb4887b. Resources: {'key_pairs'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:19:31.240977 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-af58ca2b-90e6-497d-a139-55a481d1dd54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.238135 Jun 16 16:19:31.241613 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 394/774] 10.222.0.17 () {62 vars in 1199 bytes} [Thu Jun 16 16:19:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 241 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 16:19:32.785411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:32.787318 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:32.793224 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-852437612", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6dc81646-6b2e-4fdc-9873-034ae8e222b6"}], "security_groups": [{"name": "tempest-securitygroup--377796983"}], "key_name": "tempest-keypair-1453247066", "user_data": "}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:32.949245 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] validate_networks() for [('6dc81646-6b2e-4fdc-9873-034ae8e222b6', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:19:33.550247 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:19:33.551517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:19:33.552598 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:19:33.553572 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:19:33.554557 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:19:33.578283 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:33.580430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:33.583155 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:33.584666 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:33.622864 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Getting quotas for project 5411e6d1c7a94aeeaaa8a0a30fb4887b. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:19:33.629017 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Getting quotas for user 2b32b74cc1e44ce5a7e687e3c04e8099 and project 5411e6d1c7a94aeeaaa8a0a30fb4887b. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:19:33.647839 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:19:33.655392 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:19:33.713665 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-349b045b-b0f0-4186-a775-1dcb138a22f7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.930269 Jun 16 16:19:33.714366 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 381/775] 10.222.0.17 () {62 vars in 1187 bytes} [Thu Jun 16 16:19:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 16:19:33.727303 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-5c44897b-7215-4c2e-99a8-536e93c0c6d4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:33.727929 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-5c44897b-7215-4c2e-99a8-536e93c0c6d4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:33.813903 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5c44897b-7215-4c2e-99a8-536e93c0c6d4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:33.826299 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5c44897b-7215-4c2e-99a8-536e93c0c6d4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:33.830467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5c44897b-7215-4c2e-99a8-536e93c0c6d4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:33.832912 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-5c44897b-7215-4c2e-99a8-536e93c0c6d4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1281 microversion: 2.20 time: 0.110586 Jun 16 16:19:33.839904 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 395/776] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:19:33 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1281 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:19:34.879302 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3dad548f-31e9-44ab-a4ad-052ea056bcd5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:34.880064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3dad548f-31e9-44ab-a4ad-052ea056bcd5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:34.895537 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3dad548f-31e9-44ab-a4ad-052ea056bcd5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:34.896181 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3dad548f-31e9-44ab-a4ad-052ea056bcd5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:34.897371 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3dad548f-31e9-44ab-a4ad-052ea056bcd5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:34.897678 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3dad548f-31e9-44ab-a4ad-052ea056bcd5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:35.022454 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3dad548f-31e9-44ab-a4ad-052ea056bcd5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:35.034454 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3dad548f-31e9-44ab-a4ad-052ea056bcd5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:35.036393 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3dad548f-31e9-44ab-a4ad-052ea056bcd5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:35.038743 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3dad548f-31e9-44ab-a4ad-052ea056bcd5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1333 microversion: 2.20 time: 0.174871 Jun 16 16:19:35.049143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 382/777] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:19:34 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1333 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:19:36.058876 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4238f204-9135-4a78-b64f-0ff8ffaa82ac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:36.060195 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4238f204-9135-4a78-b64f-0ff8ffaa82ac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:36.068028 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4238f204-9135-4a78-b64f-0ff8ffaa82ac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:36.068486 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4238f204-9135-4a78-b64f-0ff8ffaa82ac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:36.069280 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4238f204-9135-4a78-b64f-0ff8ffaa82ac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:36.069801 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4238f204-9135-4a78-b64f-0ff8ffaa82ac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:36.330483 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4238f204-9135-4a78-b64f-0ff8ffaa82ac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:36.339856 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4238f204-9135-4a78-b64f-0ff8ffaa82ac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:36.341420 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4238f204-9135-4a78-b64f-0ff8ffaa82ac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:36.342584 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4238f204-9135-4a78-b64f-0ff8ffaa82ac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1406 microversion: 2.20 time: 0.287599 Jun 16 16:19:36.343141 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 396/778] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:19:36 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:19:36.560943 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-82c2f070-2194-483a-8a30-4d9d075a1cdb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:36.561757 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-82c2f070-2194-483a-8a30-4d9d075a1cdb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:36.569961 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-82c2f070-2194-483a-8a30-4d9d075a1cdb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:36.570430 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-82c2f070-2194-483a-8a30-4d9d075a1cdb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:36.571259 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-82c2f070-2194-483a-8a30-4d9d075a1cdb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:36.571742 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-82c2f070-2194-483a-8a30-4d9d075a1cdb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:36.611726 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-82c2f070-2194-483a-8a30-4d9d075a1cdb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/ips" status: 200 len: 149 microversion: 2.1 time: 0.054366 Jun 16 16:19:36.617614 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 383/779] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 16:19:36 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/ips => generated 149 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:19:36.983829 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-9e4c17de-38f0-4e2e-ac10-0b0cf11591a2 req-97b89401-94ae-42b5-b038-32ec22b881f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4412fc83-e558-4531-8295-ee5a4f1ba983", "tag": "1f148a28-fe89-4254-bdba-5773896f6c82"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:37.011747 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-9e4c17de-38f0-4e2e-ac10-0b0cf11591a2 req-97b89401-94ae-42b5-b038-32ec22b881f0 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:37.012413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-9e4c17de-38f0-4e2e-ac10-0b0cf11591a2 req-97b89401-94ae-42b5-b038-32ec22b881f0 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:37.039196 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-9e4c17de-38f0-4e2e-ac10-0b0cf11591a2 req-97b89401-94ae-42b5-b038-32ec22b881f0 service nova] Creating event network-changed:1f148a28-fe89-4254-bdba-5773896f6c82 for instance 4412fc83-e558-4531-8295-ee5a4f1ba983 on hv-cinder-83716 Jun 16 16:19:37.047126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-9e4c17de-38f0-4e2e-ac10-0b0cf11591a2 req-97b89401-94ae-42b5-b038-32ec22b881f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071336 Jun 16 16:19:37.048118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 397/780] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:19:37.366610 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-af45cf3c-dc4c-4795-bbd8-f33b4ff6f772 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:37.367463 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-af45cf3c-dc4c-4795-bbd8-f33b4ff6f772 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:37.376705 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af45cf3c-dc4c-4795-bbd8-f33b4ff6f772 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:37.379147 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af45cf3c-dc4c-4795-bbd8-f33b4ff6f772 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:37.379147 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af45cf3c-dc4c-4795-bbd8-f33b4ff6f772 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:37.379751 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af45cf3c-dc4c-4795-bbd8-f33b4ff6f772 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:37.573123 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-af45cf3c-dc4c-4795-bbd8-f33b4ff6f772 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:37.585230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-af45cf3c-dc4c-4795-bbd8-f33b4ff6f772 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:37.587287 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-af45cf3c-dc4c-4795-bbd8-f33b4ff6f772 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:37.589144 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-af45cf3c-dc4c-4795-bbd8-f33b4ff6f772 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1406 microversion: 2.20 time: 0.226677 Jun 16 16:19:37.597784 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 384/781] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:19:37 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:19:38.155836 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-38b4f780-4c11-43e5-99cd-96c00feb86d1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47d54d42-1ca9-49bb-b165-a3da6612ba03"}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:38.157067 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-38b4f780-4c11-43e5-99cd-96c00feb86d1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:38.164354 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-38b4f780-4c11-43e5-99cd-96c00feb86d1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:38.164815 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-38b4f780-4c11-43e5-99cd-96c00feb86d1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:38.165605 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-38b4f780-4c11-43e5-99cd-96c00feb86d1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:38.166075 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-38b4f780-4c11-43e5-99cd-96c00feb86d1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:38.607861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-091a6cd9-2a67-4920-825c-f1943aa922d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:38.608905 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-091a6cd9-2a67-4920-825c-f1943aa922d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:38.623612 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-091a6cd9-2a67-4920-825c-f1943aa922d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:38.624310 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-091a6cd9-2a67-4920-825c-f1943aa922d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:38.626001 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-091a6cd9-2a67-4920-825c-f1943aa922d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:38.627541 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-091a6cd9-2a67-4920-825c-f1943aa922d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:38.782336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-38b4f780-4c11-43e5-99cd-96c00feb86d1 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "POST /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.629356 Jun 16 16:19:38.802271 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 398/782] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 16:19:38 2022] POST /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments => generated 194 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:19:38.864211 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-091a6cd9-2a67-4920-825c-f1943aa922d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:38.873725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-091a6cd9-2a67-4920-825c-f1943aa922d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:38.875406 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-091a6cd9-2a67-4920-825c-f1943aa922d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:38.879539 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-091a6cd9-2a67-4920-825c-f1943aa922d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1406 microversion: 2.20 time: 0.275538 Jun 16 16:19:38.880111 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 385/783] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:19:38 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:19:39.906279 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a79066f7-7898-410a-97a3-3f364b084f9b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:39.907673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a79066f7-7898-410a-97a3-3f364b084f9b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:39.914251 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a79066f7-7898-410a-97a3-3f364b084f9b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:39.914715 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a79066f7-7898-410a-97a3-3f364b084f9b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:39.915495 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a79066f7-7898-410a-97a3-3f364b084f9b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:39.915932 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a79066f7-7898-410a-97a3-3f364b084f9b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:40.056614 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a79066f7-7898-410a-97a3-3f364b084f9b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:40.065282 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a79066f7-7898-410a-97a3-3f364b084f9b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:40.066812 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a79066f7-7898-410a-97a3-3f364b084f9b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:40.067930 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a79066f7-7898-410a-97a3-3f364b084f9b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1406 microversion: 2.20 time: 0.166739 Jun 16 16:19:40.068588 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 399/784] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:19:39 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:19:41.085705 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ad3d0289-51e7-4054-b895-c32e9ad13931 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:41.087378 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ad3d0289-51e7-4054-b895-c32e9ad13931 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:41.093656 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad3d0289-51e7-4054-b895-c32e9ad13931 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:41.094134 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad3d0289-51e7-4054-b895-c32e9ad13931 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:41.094924 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad3d0289-51e7-4054-b895-c32e9ad13931 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:41.095365 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad3d0289-51e7-4054-b895-c32e9ad13931 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:41.257214 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ad3d0289-51e7-4054-b895-c32e9ad13931 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:41.267316 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ad3d0289-51e7-4054-b895-c32e9ad13931 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:41.268875 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ad3d0289-51e7-4054-b895-c32e9ad13931 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:41.270082 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ad3d0289-51e7-4054-b895-c32e9ad13931 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1406 microversion: 2.20 time: 0.188200 Jun 16 16:19:41.270636 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 386/785] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:19:41 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:19:42.288746 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1f9b55fb-c7a7-4c96-9fc1-6ab8e678083a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:42.289352 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1f9b55fb-c7a7-4c96-9fc1-6ab8e678083a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:42.296186 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1f9b55fb-c7a7-4c96-9fc1-6ab8e678083a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:42.296564 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1f9b55fb-c7a7-4c96-9fc1-6ab8e678083a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:42.297334 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1f9b55fb-c7a7-4c96-9fc1-6ab8e678083a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:42.297901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1f9b55fb-c7a7-4c96-9fc1-6ab8e678083a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:42.441436 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1f9b55fb-c7a7-4c96-9fc1-6ab8e678083a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:42.449895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1f9b55fb-c7a7-4c96-9fc1-6ab8e678083a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:42.452122 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1f9b55fb-c7a7-4c96-9fc1-6ab8e678083a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:42.454354 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1f9b55fb-c7a7-4c96-9fc1-6ab8e678083a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1406 microversion: 2.20 time: 0.169590 Jun 16 16:19:42.457797 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 400/786] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:19:42 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:19:42.525772 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-dba0ae86-6e00-4f24-b2a4-08df6e500074 req-bc0c790b-94d3-4f53-aaa9-b7ea514751f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4412fc83-e558-4531-8295-ee5a4f1ba983", "name": "network-vif-plugged", "status": "completed", "tag": "1f148a28-fe89-4254-bdba-5773896f6c82"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:42.535840 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-dba0ae86-6e00-4f24-b2a4-08df6e500074 req-bc0c790b-94d3-4f53-aaa9-b7ea514751f9 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:42.536474 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-dba0ae86-6e00-4f24-b2a4-08df6e500074 req-bc0c790b-94d3-4f53-aaa9-b7ea514751f9 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:42.553060 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-dba0ae86-6e00-4f24-b2a4-08df6e500074 req-bc0c790b-94d3-4f53-aaa9-b7ea514751f9 service nova] Creating event network-vif-plugged:1f148a28-fe89-4254-bdba-5773896f6c82 for instance 4412fc83-e558-4531-8295-ee5a4f1ba983 on hv-cinder-83716 Jun 16 16:19:42.559891 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-dba0ae86-6e00-4f24-b2a4-08df6e500074 req-bc0c790b-94d3-4f53-aaa9-b7ea514751f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037349 Jun 16 16:19:42.560747 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 387/787] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:42.821153 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-2e1840d3-7808-4130-92f8-25e5efcffc67 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:42.821652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2e1840d3-7808-4130-92f8-25e5efcffc67 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:42.829715 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2e1840d3-7808-4130-92f8-25e5efcffc67 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:42.830448 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2e1840d3-7808-4130-92f8-25e5efcffc67 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:42.831725 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2e1840d3-7808-4130-92f8-25e5efcffc67 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:42.832412 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2e1840d3-7808-4130-92f8-25e5efcffc67 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:42.869362 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-2e1840d3-7808-4130-92f8-25e5efcffc67 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/ips" status: 200 len: 146 microversion: 2.1 time: 0.052076 Jun 16 16:19:42.869994 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 401/788] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 16:19:42 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/ips => generated 146 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:43.473961 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-682b4f7b-38c2-4699-a520-94189452a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:43.474926 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-682b4f7b-38c2-4699-a520-94189452a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:43.482021 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-682b4f7b-38c2-4699-a520-94189452a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:43.482451 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-682b4f7b-38c2-4699-a520-94189452a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:43.483321 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-682b4f7b-38c2-4699-a520-94189452a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:43.483757 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-682b4f7b-38c2-4699-a520-94189452a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:43.600051 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=2 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:43.638648 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=6 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:43.652500 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-682b4f7b-38c2-4699-a520-94189452a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:43.661185 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-682b4f7b-38c2-4699-a520-94189452a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:43.662757 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-682b4f7b-38c2-4699-a520-94189452a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:43.663893 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-682b4f7b-38c2-4699-a520-94189452a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1406 microversion: 2.20 time: 0.195000 Jun 16 16:19:43.664755 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 388/789] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:19:43 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:19:44.247798 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-cb564af0-cd24-4776-a71b-0d910ae54946 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "beba1b15-c611-464e-9e99-cc2b2d6de0f8"}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:44.248919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-cb564af0-cd24-4776-a71b-0d910ae54946 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:44.251615 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=6 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:44.258973 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cb564af0-cd24-4776-a71b-0d910ae54946 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.259431 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cb564af0-cd24-4776-a71b-0d910ae54946 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:44.260228 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cb564af0-cd24-4776-a71b-0d910ae54946 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.260670 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cb564af0-cd24-4776-a71b-0d910ae54946 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:44.686450 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5489eb2d-ff64-43ba-a6e9-0e8e030bf1e9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:44.687913 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5489eb2d-ff64-43ba-a6e9-0e8e030bf1e9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:44.697826 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5489eb2d-ff64-43ba-a6e9-0e8e030bf1e9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.698570 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5489eb2d-ff64-43ba-a6e9-0e8e030bf1e9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:44.699852 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5489eb2d-ff64-43ba-a6e9-0e8e030bf1e9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.700511 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5489eb2d-ff64-43ba-a6e9-0e8e030bf1e9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:44.861549 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5489eb2d-ff64-43ba-a6e9-0e8e030bf1e9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:44.869810 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5489eb2d-ff64-43ba-a6e9-0e8e030bf1e9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:44.871374 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5489eb2d-ff64-43ba-a6e9-0e8e030bf1e9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:44.872573 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5489eb2d-ff64-43ba-a6e9-0e8e030bf1e9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1598 microversion: 2.20 time: 0.192498 Jun 16 16:19:44.873251 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 389/790] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:19:44 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1598 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:19:44.891608 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-633bbff3-6120-496b-ab23-aac443f37ef1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:44.892132 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-633bbff3-6120-496b-ab23-aac443f37ef1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:44.900534 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-633bbff3-6120-496b-ab23-aac443f37ef1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.901271 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-633bbff3-6120-496b-ab23-aac443f37ef1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:44.902314 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-633bbff3-6120-496b-ab23-aac443f37ef1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.902760 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-633bbff3-6120-496b-ab23-aac443f37ef1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:45.019144 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-633bbff3-6120-496b-ab23-aac443f37ef1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.131987 Jun 16 16:19:45.020227 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 390/791] 10.222.0.17 () {60 vars in 1315 bytes} [Thu Jun 16 16:19:44 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 16:19:45.171338 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-cb564af0-cd24-4776-a71b-0d910ae54946 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "POST /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.927252 Jun 16 16:19:45.173094 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 402/792] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 16:19:44 2022] POST /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments => generated 194 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:46.428922 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-247606fe-e7c1-41de-a9f4-2ecc11c4346a req-256fe84c-5722-452d-8c25-e0b449844ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4412fc83-e558-4531-8295-ee5a4f1ba983", "tag": "1f148a28-fe89-4254-bdba-5773896f6c82"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:46.437803 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-247606fe-e7c1-41de-a9f4-2ecc11c4346a req-256fe84c-5722-452d-8c25-e0b449844ee2 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:46.438538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-247606fe-e7c1-41de-a9f4-2ecc11c4346a req-256fe84c-5722-452d-8c25-e0b449844ee2 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:46.451188 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-247606fe-e7c1-41de-a9f4-2ecc11c4346a req-256fe84c-5722-452d-8c25-e0b449844ee2 service nova] Creating event network-changed:1f148a28-fe89-4254-bdba-5773896f6c82 for instance 4412fc83-e558-4531-8295-ee5a4f1ba983 on hv-cinder-83716 Jun 16 16:19:46.456379 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-247606fe-e7c1-41de-a9f4-2ecc11c4346a req-256fe84c-5722-452d-8c25-e0b449844ee2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031813 Jun 16 16:19:46.457543 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 391/793] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:46.553062 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a096d4b4-4807-4c2f-93b2-f31b8451ced7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:46.554554 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a096d4b4-4807-4c2f-93b2-f31b8451ced7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:46.561866 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a096d4b4-4807-4c2f-93b2-f31b8451ced7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:46.562727 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a096d4b4-4807-4c2f-93b2-f31b8451ced7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:46.563513 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a096d4b4-4807-4c2f-93b2-f31b8451ced7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:46.564129 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a096d4b4-4807-4c2f-93b2-f31b8451ced7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:46.660486 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-a096d4b4-4807-4c2f-93b2-f31b8451ced7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lazy-loading 'services' on Instance uuid a345636a-18e8-47a4-94ae-64363ef57f55 {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:19:46.744652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a096d4b4-4807-4c2f-93b2-f31b8451ced7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments/47d54d42-1ca9-49bb-b165-a3da6612ba03" status: 202 len: 0 microversion: 2.1 time: 0.196141 Jun 16 16:19:46.748885 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 403/794] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 16:19:46 2022] DELETE /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments/47d54d42-1ca9-49bb-b165-a3da6612ba03 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:19:46.762568 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3c885bf3-811a-41df-8148-9a4ab3dcdc47 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:46.769899 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3c885bf3-811a-41df-8148-9a4ab3dcdc47 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:46.784643 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c885bf3-811a-41df-8148-9a4ab3dcdc47 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:46.785406 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c885bf3-811a-41df-8148-9a4ab3dcdc47 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:46.786406 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c885bf3-811a-41df-8148-9a4ab3dcdc47 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:46.787128 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c885bf3-811a-41df-8148-9a4ab3dcdc47 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:46.841576 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3c885bf3-811a-41df-8148-9a4ab3dcdc47 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086242 Jun 16 16:19:46.845656 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 392/795] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:19:46 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:47.854066 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-33a70ce4-6f96-4c7d-8197-d52bd028206e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:47.855163 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-33a70ce4-6f96-4c7d-8197-d52bd028206e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:47.862290 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-33a70ce4-6f96-4c7d-8197-d52bd028206e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:47.862742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-33a70ce4-6f96-4c7d-8197-d52bd028206e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:47.863546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-33a70ce4-6f96-4c7d-8197-d52bd028206e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:47.863991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-33a70ce4-6f96-4c7d-8197-d52bd028206e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:47.895103 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-33a70ce4-6f96-4c7d-8197-d52bd028206e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045751 Jun 16 16:19:47.896043 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 404/796] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:19:47 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:48.907364 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-05ccfba4-455f-4099-a27d-5aa6b4fd72a2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:48.908290 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-05ccfba4-455f-4099-a27d-5aa6b4fd72a2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:48.914856 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-05ccfba4-455f-4099-a27d-5aa6b4fd72a2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:48.915312 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-05ccfba4-455f-4099-a27d-5aa6b4fd72a2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:48.916084 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-05ccfba4-455f-4099-a27d-5aa6b4fd72a2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:48.916526 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-05ccfba4-455f-4099-a27d-5aa6b4fd72a2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:48.946147 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-05ccfba4-455f-4099-a27d-5aa6b4fd72a2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042944 Jun 16 16:19:48.946705 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 393/797] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:19:48 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:49.958747 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4cd72b11-782b-4dbf-bd65-f4fcffef9eb8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:49.959665 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4cd72b11-782b-4dbf-bd65-f4fcffef9eb8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:49.966294 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4cd72b11-782b-4dbf-bd65-f4fcffef9eb8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:49.966725 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4cd72b11-782b-4dbf-bd65-f4fcffef9eb8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:49.967503 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4cd72b11-782b-4dbf-bd65-f4fcffef9eb8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:49.967939 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4cd72b11-782b-4dbf-bd65-f4fcffef9eb8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:49.999178 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4cd72b11-782b-4dbf-bd65-f4fcffef9eb8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044522 Jun 16 16:19:50.000517 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 405/798] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:19:49 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:51.011799 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-788fa9f7-4f6b-45c5-9531-f4985cc2d3f8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:51.012718 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-788fa9f7-4f6b-45c5-9531-f4985cc2d3f8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:51.019620 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-788fa9f7-4f6b-45c5-9531-f4985cc2d3f8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:51.020070 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-788fa9f7-4f6b-45c5-9531-f4985cc2d3f8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:51.020856 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-788fa9f7-4f6b-45c5-9531-f4985cc2d3f8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:51.021302 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-788fa9f7-4f6b-45c5-9531-f4985cc2d3f8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:51.057365 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-788fa9f7-4f6b-45c5-9531-f4985cc2d3f8 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049758 Jun 16 16:19:51.057947 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 394/799] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:19:51 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:52.070779 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fbb0c5da-4bf5-4083-b49b-a16c658dda51 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:52.072153 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-fbb0c5da-4bf5-4083-b49b-a16c658dda51 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:52.082301 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fbb0c5da-4bf5-4083-b49b-a16c658dda51 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:52.083053 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fbb0c5da-4bf5-4083-b49b-a16c658dda51 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:52.084409 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fbb0c5da-4bf5-4083-b49b-a16c658dda51 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:52.085371 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fbb0c5da-4bf5-4083-b49b-a16c658dda51 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:52.119135 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fbb0c5da-4bf5-4083-b49b-a16c658dda51 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053681 Jun 16 16:19:52.119714 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 406/800] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:19:52 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:52.735990 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f66c33c1-5729-45e6-a1da-1899886bb773 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:52.736904 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f66c33c1-5729-45e6-a1da-1899886bb773 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:52.744518 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f66c33c1-5729-45e6-a1da-1899886bb773 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:52.744969 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f66c33c1-5729-45e6-a1da-1899886bb773 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:52.745747 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f66c33c1-5729-45e6-a1da-1899886bb773 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:52.746208 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f66c33c1-5729-45e6-a1da-1899886bb773 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:52.776613 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f66c33c1-5729-45e6-a1da-1899886bb773 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045041 Jun 16 16:19:52.777178 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 395/801] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:19:52 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:52.788334 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-14fdd2a7-71d1-4cb5-b0ef-31c76d7b1e5d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:52.789193 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-14fdd2a7-71d1-4cb5-b0ef-31c76d7b1e5d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:52.795219 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-14fdd2a7-71d1-4cb5-b0ef-31c76d7b1e5d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:52.795705 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-14fdd2a7-71d1-4cb5-b0ef-31c76d7b1e5d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:52.796489 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-14fdd2a7-71d1-4cb5-b0ef-31c76d7b1e5d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:52.796933 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-14fdd2a7-71d1-4cb5-b0ef-31c76d7b1e5d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:52.829394 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-14fdd2a7-71d1-4cb5-b0ef-31c76d7b1e5d tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments/beba1b15-c611-464e-9e99-cc2b2d6de0f8" status: 200 len: 194 microversion: 2.1 time: 0.044911 Jun 16 16:19:52.829998 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 407/802] 10.222.0.17 () {58 vars in 1412 bytes} [Thu Jun 16 16:19:52 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments/beba1b15-c611-464e-9e99-cc2b2d6de0f8 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:19:53.131907 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0c9fc57e-ee2b-4bb2-9c54-6a8959274749 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:53.132840 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0c9fc57e-ee2b-4bb2-9c54-6a8959274749 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:53.139274 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c9fc57e-ee2b-4bb2-9c54-6a8959274749 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:53.139811 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c9fc57e-ee2b-4bb2-9c54-6a8959274749 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:53.140609 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c9fc57e-ee2b-4bb2-9c54-6a8959274749 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:53.141109 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c9fc57e-ee2b-4bb2-9c54-6a8959274749 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:53.170661 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0c9fc57e-ee2b-4bb2-9c54-6a8959274749 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042870 Jun 16 16:19:53.171133 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 396/803] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:19:53 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 16:19:53.235108 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-15734fa9-6bdf-431f-9c98-1c610b2854fb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:53.235657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-15734fa9-6bdf-431f-9c98-1c610b2854fb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:53.242900 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-15734fa9-6bdf-431f-9c98-1c610b2854fb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:53.243365 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-15734fa9-6bdf-431f-9c98-1c610b2854fb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:53.244153 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-15734fa9-6bdf-431f-9c98-1c610b2854fb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:53.244593 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-15734fa9-6bdf-431f-9c98-1c610b2854fb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:53.285165 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-15734fa9-6bdf-431f-9c98-1c610b2854fb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Going to try to terminate instance {{(pid=117756) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:19:53.335295 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:53.372201 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-15734fa9-6bdf-431f-9c98-1c610b2854fb tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 204 len: 0 microversion: 2.1 time: 0.141502 Jun 16 16:19:53.372974 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 408/804] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:19:53 2022] DELETE /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:19:53.381887 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3bc518e4-cb85-4855-95ed-8b3c776569ae tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:53.382594 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3bc518e4-cb85-4855-95ed-8b3c776569ae tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:53.388860 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3bc518e4-cb85-4855-95ed-8b3c776569ae tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:53.389302 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3bc518e4-cb85-4855-95ed-8b3c776569ae tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:53.390167 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3bc518e4-cb85-4855-95ed-8b3c776569ae tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:53.390898 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3bc518e4-cb85-4855-95ed-8b3c776569ae tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:53.536478 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3bc518e4-cb85-4855-95ed-8b3c776569ae tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:53.544523 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3bc518e4-cb85-4855-95ed-8b3c776569ae tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1680 microversion: 2.1 time: 0.166628 Jun 16 16:19:53.545189 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 397/805] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:53 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:54.166472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-448efd00-d694-4700-a3ad-50c187bc10f3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c427a865-1d0b-4725-bace-2245efc3b866"}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:54.167510 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-448efd00-d694-4700-a3ad-50c187bc10f3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:54.173847 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-448efd00-d694-4700-a3ad-50c187bc10f3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:54.174337 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-448efd00-d694-4700-a3ad-50c187bc10f3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:54.175116 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-448efd00-d694-4700-a3ad-50c187bc10f3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:54.175549 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-448efd00-d694-4700-a3ad-50c187bc10f3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:54.563663 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ab003646-e2ac-48d2-867c-211ee67029b7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:54.564408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ab003646-e2ac-48d2-867c-211ee67029b7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:54.571337 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ab003646-e2ac-48d2-867c-211ee67029b7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:54.571792 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ab003646-e2ac-48d2-867c-211ee67029b7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:54.572573 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ab003646-e2ac-48d2-867c-211ee67029b7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:54.573044 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ab003646-e2ac-48d2-867c-211ee67029b7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:54.739837 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ab003646-e2ac-48d2-867c-211ee67029b7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:54.749360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ab003646-e2ac-48d2-867c-211ee67029b7 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1680 microversion: 2.1 time: 0.190261 Jun 16 16:19:54.750968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 398/806] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:54 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:55.025259 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-448efd00-d694-4700-a3ad-50c187bc10f3 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "POST /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.863099 Jun 16 16:19:55.026370 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 409/807] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 16:19:54 2022] POST /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments => generated 194 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:55.777845 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d2d90ab0-ba6d-4c18-8213-b358c28e85de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:55.779159 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d2d90ab0-ba6d-4c18-8213-b358c28e85de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:55.786935 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d2d90ab0-ba6d-4c18-8213-b358c28e85de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:55.787628 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d2d90ab0-ba6d-4c18-8213-b358c28e85de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:55.788563 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d2d90ab0-ba6d-4c18-8213-b358c28e85de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:55.789148 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d2d90ab0-ba6d-4c18-8213-b358c28e85de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:55.855905 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d2d90ab0-ba6d-4c18-8213-b358c28e85de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:55.867416 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d2d90ab0-ba6d-4c18-8213-b358c28e85de tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1613 microversion: 2.1 time: 0.095537 Jun 16 16:19:55.868355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 399/808] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:55 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1613 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:56.067646 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-c10086dd-9390-4a0d-8743-e4ef7db766b7 req-a7d3a2d6-e521-4247-a958-08dca7aaa489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a345636a-18e8-47a4-94ae-64363ef57f55", "name": "network-vif-deleted", "tag": "090307fe-9628-4c5e-8a8c-15b983b49709"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:56.079538 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-c10086dd-9390-4a0d-8743-e4ef7db766b7 req-a7d3a2d6-e521-4247-a958-08dca7aaa489 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:56.080365 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-c10086dd-9390-4a0d-8743-e4ef7db766b7 req-a7d3a2d6-e521-4247-a958-08dca7aaa489 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:56.094843 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-c10086dd-9390-4a0d-8743-e4ef7db766b7 req-a7d3a2d6-e521-4247-a958-08dca7aaa489 service nova] Creating event network-vif-deleted:090307fe-9628-4c5e-8a8c-15b983b49709 for instance a345636a-18e8-47a4-94ae-64363ef57f55 on hv-cinder-83716 Jun 16 16:19:56.102516 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-c10086dd-9390-4a0d-8743-e4ef7db766b7 req-a7d3a2d6-e521-4247-a958-08dca7aaa489 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040614 Jun 16 16:19:56.103445 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 410/809] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:56.886767 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bb19515a-c494-4135-948c-4ad94c1eb94f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:56.887413 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bb19515a-c494-4135-948c-4ad94c1eb94f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:56.894806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb19515a-c494-4135-948c-4ad94c1eb94f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:56.895499 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb19515a-c494-4135-948c-4ad94c1eb94f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:56.896633 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb19515a-c494-4135-948c-4ad94c1eb94f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:56.897293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb19515a-c494-4135-948c-4ad94c1eb94f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:56.902022 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=100 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:56.934480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb19515a-c494-4135-948c-4ad94c1eb94f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:56.935220 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb19515a-c494-4135-948c-4ad94c1eb94f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:56.935866 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-bb19515a-c494-4135-948c-4ad94c1eb94f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lazy-loading 'fault' on Instance uuid a345636a-18e8-47a4-94ae-64363ef57f55 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:19:56.978964 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bb19515a-c494-4135-948c-4ad94c1eb94f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c34f05634d34da29088bcf75069958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b091584c67814e4d8f7e88f0596880e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:56.987184 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bb19515a-c494-4135-948c-4ad94c1eb94f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 200 len: 1331 microversion: 2.1 time: 0.104755 Jun 16 16:19:56.987769 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 400/810] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:56 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:58.005582 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a7ddb7cf-8bd4-4be3-8ce1-23bd98e8328f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:58.006388 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a7ddb7cf-8bd4-4be3-8ce1-23bd98e8328f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:58.013522 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a7ddb7cf-8bd4-4be3-8ce1-23bd98e8328f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:58.014045 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a7ddb7cf-8bd4-4be3-8ce1-23bd98e8328f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:58.014788 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a7ddb7cf-8bd4-4be3-8ce1-23bd98e8328f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:58.015351 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a7ddb7cf-8bd4-4be3-8ce1-23bd98e8328f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:58.028616 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-a7ddb7cf-8bd4-4be3-8ce1-23bd98e8328f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] HTTP exception thrown: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a7ddb7cf-8bd4-4be3-8ce1-23bd98e8328f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Request method failure captured: Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 HTTP/1.1 Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ZUq1kgzW_sDLNXIMMrLIuaVIQDyIYyD_QFPpTquNy4hAl_e3YmJtCQ9vDG5Gi9dl3M7alwHb45g-Cko2VZfCdciDPJaW1quIm5ySkHotQHkgN6wNvH9ZeEMkPp9RFHfNBz6m-xTNRiXVTSKnJGaGWLNz7_WuUCsTsM3KjkFbV_vCQ Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:19:58.030273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:19:58.031923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}] Jun 16 16:19:58.031923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:19:58.031923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:19:58.031923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:19:58.031923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:19:58.031923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:19:58.031923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:19:58.031923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 2c34f05634d34da29088bcf75069958d Jun 16 16:19:58.031923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:19:58.031923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:19:58.031923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. Jun 16 16:19:58.031923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': 'a345636a-18e8-47a4-94ae-64363ef57f55'} Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:19:58.033003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. Jun 16 16:19:58.034663 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:58.036039 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a7ddb7cf-8bd4-4be3-8ce1-23bd98e8328f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Returning 404 to user: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:19:58.036039 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a7ddb7cf-8bd4-4be3-8ce1-23bd98e8328f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 404 len: 111 microversion: 2.1 time: 0.031275 Jun 16 16:19:58.036039 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 411/811] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:57 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:19:58.042263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c2e53a38-8baf-4fcd-b8ed-f2d93c1ebe57 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '.version_select at 0x7f38bb4339d0>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:58.060883 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c2e53a38-8baf-4fcd-b8ed-f2d93c1ebe57 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-392797866" status: 202 len: 0 microversion: 2.1 time: 0.022502 Jun 16 16:19:58.061459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 401/812] 10.222.0.17 () {58 vars in 1217 bytes} [Thu Jun 16 16:19:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-392797866 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:19:59.886996 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c5b696ec-e73f-4e75-9111-e0315e59b6a4 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:59.887575 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c5b696ec-e73f-4e75-9111-e0315e59b6a4 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:59.894780 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c5b696ec-e73f-4e75-9111-e0315e59b6a4 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:59.895239 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c5b696ec-e73f-4e75-9111-e0315e59b6a4 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:59.896023 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c5b696ec-e73f-4e75-9111-e0315e59b6a4 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:59.896461 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c5b696ec-e73f-4e75-9111-e0315e59b6a4 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:59.910715 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-c5b696ec-e73f-4e75-9111-e0315e59b6a4 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] HTTP exception thrown: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c5b696ec-e73f-4e75-9111-e0315e59b6a4 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Request method failure captured: Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: DELETE /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 HTTP/1.1 Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ZUq1kgzW_sDLNXIMMrLIuaVIQDyIYyD_QFPpTquNy4hAl_e3YmJtCQ9vDG5Gi9dl3M7alwHb45g-Cko2VZfCdciDPJaW1quIm5ySkHotQHkgN6wNvH9ZeEMkPp9RFHfNBz6m-xTNRiXVTSKnJGaGWLNz7_WuUCsTsM3KjkFbV_vCQ Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:19:59.912260 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:19:59.913959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}] Jun 16 16:19:59.913959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:19:59.913959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:19:59.913959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:19:59.913959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:19:59.913959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:19:59.913959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:19:59.913959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 2c34f05634d34da29088bcf75069958d Jun 16 16:19:59.913959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:19:59.913959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:19:59.913959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. Jun 16 16:19:59.913959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': 'a345636a-18e8-47a4-94ae-64363ef57f55'} Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:19:59.914886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. Jun 16 16:19:59.916070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:19:59.917280 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c5b696ec-e73f-4e75-9111-e0315e59b6a4 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Returning 404 to user: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:19:59.917280 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c5b696ec-e73f-4e75-9111-e0315e59b6a4 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 404 len: 111 microversion: 2.1 time: 0.030753 Jun 16 16:19:59.917280 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 412/813] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:19:59 2022] DELETE /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:19:59.923042 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-eac861c2-8bad-443d-b3fa-1bca88bceb8f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:59.923747 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-eac861c2-8bad-443d-b3fa-1bca88bceb8f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: a345636a-18e8-47a4-94ae-64363ef57f55] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:59.930500 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eac861c2-8bad-443d-b3fa-1bca88bceb8f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:59.930957 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eac861c2-8bad-443d-b3fa-1bca88bceb8f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:59.931727 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eac861c2-8bad-443d-b3fa-1bca88bceb8f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:59.932168 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eac861c2-8bad-443d-b3fa-1bca88bceb8f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:59.946416 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-eac861c2-8bad-443d-b3fa-1bca88bceb8f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] HTTP exception thrown: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-eac861c2-8bad-443d-b3fa-1bca88bceb8f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Request method failure captured: Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 HTTP/1.1 Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ZUq1kgzW_sDLNXIMMrLIuaVIQDyIYyD_QFPpTquNy4hAl_e3YmJtCQ9vDG5Gi9dl3M7alwHb45g-Cko2VZfCdciDPJaW1quIm5ySkHotQHkgN6wNvH9ZeEMkPp9RFHfNBz6m-xTNRiXVTSKnJGaGWLNz7_WuUCsTsM3KjkFbV_vCQ Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:19:59.948081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:19:59.949533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}] Jun 16 16:19:59.949533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:19:59.949533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:19:59.949533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:19:59.949533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:19:59.949533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:19:59.949533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:19:59.949533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 2c34f05634d34da29088bcf75069958d Jun 16 16:19:59.949533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:19:59.949533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:19:59.949533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. Jun 16 16:19:59.949533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': 'a345636a-18e8-47a4-94ae-64363ef57f55'} Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:19:59.950332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. Jun 16 16:19:59.951585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:19:59.954131 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-eac861c2-8bad-443d-b3fa-1bca88bceb8f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Returning 404 to user: Instance a345636a-18e8-47a4-94ae-64363ef57f55 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:19:59.954131 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-eac861c2-8bad-443d-b3fa-1bca88bceb8f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55" status: 404 len: 111 microversion: 2.1 time: 0.030937 Jun 16 16:19:59.954131 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 402/814] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:59 2022] GET /compute/v2.1/servers/a345636a-18e8-47a4-94ae-64363ef57f55 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:20:01.111761 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ea4f614f-2c99-4d0f-ad85-2ea68b07abc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:01.112579 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ea4f614f-2c99-4d0f-ad85-2ea68b07abc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:01.115153 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:01.124734 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ea4f614f-2c99-4d0f-ad85-2ea68b07abc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:01.126055 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ea4f614f-2c99-4d0f-ad85-2ea68b07abc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:01.127409 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ea4f614f-2c99-4d0f-ad85-2ea68b07abc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:01.128172 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ea4f614f-2c99-4d0f-ad85-2ea68b07abc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:01.149157 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-ea4f614f-2c99-4d0f-ad85-2ea68b07abc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] HTTP exception thrown: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ea4f614f-2c99-4d0f-ad85-2ea68b07abc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Request method failure captured: Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: DELETE /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe HTTP/1.1 Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ZUq1kgzW_sDLNXIMMrLIuaVIQDyIYyD_QFPpTquNy4hAl_e3YmJtCQ9vDG5Gi9dl3M7alwHb45g-Cko2VZfCdciDPJaW1quIm5ySkHotQHkgN6wNvH9ZeEMkPp9RFHfNBz6m-xTNRiXVTSKnJGaGWLNz7_WuUCsTsM3KjkFbV_vCQ Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:20:01.150763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:20:01.152306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}] Jun 16 16:20:01.152306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:01.152306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:20:01.152306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:01.152306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:20:01.152306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:20:01.152306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:20:01.152306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 2c34f05634d34da29088bcf75069958d Jun 16 16:20:01.152306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:20:01.152306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:20:01.152306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. Jun 16 16:20:01.152306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': 'e2e89e07-513d-41ba-982f-b29bbc494ffe'} Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:20:01.153336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. Jun 16 16:20:01.154923 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.156535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ea4f614f-2c99-4d0f-ad85-2ea68b07abc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Returning 404 to user: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:20:01.156535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ea4f614f-2c99-4d0f-ad85-2ea68b07abc2 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 404 len: 111 microversion: 2.1 time: 0.046620 Jun 16 16:20:01.156535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 413/815] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:20:01 2022] DELETE /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:20:01.161156 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-459ec8b0-7850-4440-ae1a-85b0f7803735 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:01.161779 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-459ec8b0-7850-4440-ae1a-85b0f7803735 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e2e89e07-513d-41ba-982f-b29bbc494ffe] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:01.168528 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-459ec8b0-7850-4440-ae1a-85b0f7803735 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:01.168977 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-459ec8b0-7850-4440-ae1a-85b0f7803735 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:01.169749 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-459ec8b0-7850-4440-ae1a-85b0f7803735 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:01.170230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-459ec8b0-7850-4440-ae1a-85b0f7803735 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:01.186097 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-459ec8b0-7850-4440-ae1a-85b0f7803735 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] HTTP exception thrown: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-459ec8b0-7850-4440-ae1a-85b0f7803735 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Request method failure captured: Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe HTTP/1.1 Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ZUq1kgzW_sDLNXIMMrLIuaVIQDyIYyD_QFPpTquNy4hAl_e3YmJtCQ9vDG5Gi9dl3M7alwHb45g-Cko2VZfCdciDPJaW1quIm5ySkHotQHkgN6wNvH9ZeEMkPp9RFHfNBz6m-xTNRiXVTSKnJGaGWLNz7_WuUCsTsM3KjkFbV_vCQ Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:20:01.188464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:20:01.190230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}] Jun 16 16:20:01.190230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:01.190230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:20:01.190230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:01.190230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:20:01.190230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:20:01.190230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:20:01.190230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 2c34f05634d34da29088bcf75069958d Jun 16 16:20:01.190230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:20:01.190230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:20:01.190230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. Jun 16 16:20:01.190230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': 'e2e89e07-513d-41ba-982f-b29bbc494ffe'} Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:20:01.191179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. Jun 16 16:20:01.192950 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.195646 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-459ec8b0-7850-4440-ae1a-85b0f7803735 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Returning 404 to user: Instance e2e89e07-513d-41ba-982f-b29bbc494ffe could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:20:01.195646 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-459ec8b0-7850-4440-ae1a-85b0f7803735 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe" status: 404 len: 111 microversion: 2.1 time: 0.032549 Jun 16 16:20:01.195646 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 403/816] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:01 2022] GET /compute/v2.1/servers/e2e89e07-513d-41ba-982f-b29bbc494ffe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:20:01.201795 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c9fbd2ea-aa9e-4e61-8dfd-2d19a0a475d9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:01.203679 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c9fbd2ea-aa9e-4e61-8dfd-2d19a0a475d9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:01.211741 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c9fbd2ea-aa9e-4e61-8dfd-2d19a0a475d9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:01.212241 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c9fbd2ea-aa9e-4e61-8dfd-2d19a0a475d9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:01.213089 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c9fbd2ea-aa9e-4e61-8dfd-2d19a0a475d9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:01.213507 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c9fbd2ea-aa9e-4e61-8dfd-2d19a0a475d9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:01.228131 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-c9fbd2ea-aa9e-4e61-8dfd-2d19a0a475d9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] HTTP exception thrown: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c9fbd2ea-aa9e-4e61-8dfd-2d19a0a475d9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Request method failure captured: Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: DELETE /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 HTTP/1.1 Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ZUq1kgzW_sDLNXIMMrLIuaVIQDyIYyD_QFPpTquNy4hAl_e3YmJtCQ9vDG5Gi9dl3M7alwHb45g-Cko2VZfCdciDPJaW1quIm5ySkHotQHkgN6wNvH9ZeEMkPp9RFHfNBz6m-xTNRiXVTSKnJGaGWLNz7_WuUCsTsM3KjkFbV_vCQ Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:20:01.229673 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:20:01.233188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}] Jun 16 16:20:01.233188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:01.233188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:20:01.233188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:01.233188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:20:01.233188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:20:01.233188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:20:01.233188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 2c34f05634d34da29088bcf75069958d Jun 16 16:20:01.233188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:20:01.233188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:20:01.233188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. Jun 16 16:20:01.233188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': '65f1126e-5b19-4b56-aa87-c4be0b53eb85'} Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:20:01.235385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. Jun 16 16:20:01.238136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.240838 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c9fbd2ea-aa9e-4e61-8dfd-2d19a0a475d9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Returning 404 to user: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:20:01.240838 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c9fbd2ea-aa9e-4e61-8dfd-2d19a0a475d9 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "DELETE /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 404 len: 111 microversion: 2.1 time: 0.036473 Jun 16 16:20:01.240838 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 414/817] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:20:01 2022] DELETE /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:20:01.246029 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ce2eec12-127b-4acd-9fb6-10e862d41a6f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:01.247213 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ce2eec12-127b-4acd-9fb6-10e862d41a6f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: 65f1126e-5b19-4b56-aa87-c4be0b53eb85] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:01.259257 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce2eec12-127b-4acd-9fb6-10e862d41a6f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:01.259987 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce2eec12-127b-4acd-9fb6-10e862d41a6f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:01.261134 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce2eec12-127b-4acd-9fb6-10e862d41a6f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:01.261834 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ce2eec12-127b-4acd-9fb6-10e862d41a6f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:01.282141 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-ce2eec12-127b-4acd-9fb6-10e862d41a6f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] HTTP exception thrown: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ce2eec12-127b-4acd-9fb6-10e862d41a6f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Request method failure captured: Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 HTTP/1.1 Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ZUq1kgzW_sDLNXIMMrLIuaVIQDyIYyD_QFPpTquNy4hAl_e3YmJtCQ9vDG5Gi9dl3M7alwHb45g-Cko2VZfCdciDPJaW1quIm5ySkHotQHkgN6wNvH9ZeEMkPp9RFHfNBz6m-xTNRiXVTSKnJGaGWLNz7_WuUCsTsM3KjkFbV_vCQ Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:20:01.283711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:20:01.285275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}] Jun 16 16:20:01.285275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:01.285275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:20:01.285275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:01.285275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:20:01.285275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:20:01.285275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:20:01.285275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 2c34f05634d34da29088bcf75069958d Jun 16 16:20:01.285275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:20:01.285275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:20:01.285275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. Jun 16 16:20:01.285275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': '65f1126e-5b19-4b56-aa87-c4be0b53eb85'} Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:20:01.286096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. Jun 16 16:20:01.287535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.288820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ce2eec12-127b-4acd-9fb6-10e862d41a6f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Returning 404 to user: Instance 65f1126e-5b19-4b56-aa87-c4be0b53eb85 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:20:01.288820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ce2eec12-127b-4acd-9fb6-10e862d41a6f tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85" status: 404 len: 111 microversion: 2.1 time: 0.046212 Jun 16 16:20:01.288820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 404/818] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:01 2022] GET /compute/v2.1/servers/65f1126e-5b19-4b56-aa87-c4be0b53eb85 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:20:02.455904 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f8475140-263e-4499-b74d-33b33cf3202e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:02.456422 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f8475140-263e-4499-b74d-33b33cf3202e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:02.463008 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f8475140-263e-4499-b74d-33b33cf3202e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.463464 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f8475140-263e-4499-b74d-33b33cf3202e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.464235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f8475140-263e-4499-b74d-33b33cf3202e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.464669 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f8475140-263e-4499-b74d-33b33cf3202e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.481711 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-f8475140-263e-4499-b74d-33b33cf3202e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] HTTP exception thrown: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f8475140-263e-4499-b74d-33b33cf3202e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Request method failure captured: Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: DELETE /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae HTTP/1.1 Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ZUq1kgzW_sDLNXIMMrLIuaVIQDyIYyD_QFPpTquNy4hAl_e3YmJtCQ9vDG5Gi9dl3M7alwHb45g-Cko2VZfCdciDPJaW1quIm5ySkHotQHkgN6wNvH9ZeEMkPp9RFHfNBz6m-xTNRiXVTSKnJGaGWLNz7_WuUCsTsM3KjkFbV_vCQ Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:20:02.483287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:20:02.485118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}] Jun 16 16:20:02.485118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:02.485118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:20:02.485118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:02.485118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:20:02.485118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:20:02.485118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:20:02.485118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 2c34f05634d34da29088bcf75069958d Jun 16 16:20:02.485118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:20:02.485118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:20:02.485118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. Jun 16 16:20:02.485118 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': 'e263395e-8f5e-4b76-85de-41bf42f947ae'} Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:20:02.486185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. Jun 16 16:20:02.487467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:02.489025 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f8475140-263e-4499-b74d-33b33cf3202e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Returning 404 to user: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:20:02.489025 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f8475140-263e-4499-b74d-33b33cf3202e tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 404 len: 111 microversion: 2.1 time: 0.034513 Jun 16 16:20:02.489025 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 415/819] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:20:02 2022] DELETE /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:20:02.494135 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1c7570c2-4284-46f2-aa2e-0d6d2e4edf01 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:02.494904 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1c7570c2-4284-46f2-aa2e-0d6d2e4edf01 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] [instance: e263395e-8f5e-4b76-85de-41bf42f947ae] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:02.501739 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c7570c2-4284-46f2-aa2e-0d6d2e4edf01 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.502229 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c7570c2-4284-46f2-aa2e-0d6d2e4edf01 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.503116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c7570c2-4284-46f2-aa2e-0d6d2e4edf01 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.503553 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c7570c2-4284-46f2-aa2e-0d6d2e4edf01 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.518840 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-1c7570c2-4284-46f2-aa2e-0d6d2e4edf01 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] HTTP exception thrown: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1c7570c2-4284-46f2-aa2e-0d6d2e4edf01 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Request method failure captured: Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae HTTP/1.1 Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ZUq1kgzW_sDLNXIMMrLIuaVIQDyIYyD_QFPpTquNy4hAl_e3YmJtCQ9vDG5Gi9dl3M7alwHb45g-Cko2VZfCdciDPJaW1quIm5ySkHotQHkgN6wNvH9ZeEMkPp9RFHfNBz6m-xTNRiXVTSKnJGaGWLNz7_WuUCsTsM3KjkFbV_vCQ Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:20:02.520433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:20:02.522072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091584c67814e4d8f7e88f0596880e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091584c67814e4d8f7e88f0596880e3"}]}] Jun 16 16:20:02.522072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:02.522072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: b091584c67814e4d8f7e88f0596880e3 Jun 16 16:20:02.522072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-939462868 Jun 16 16:20:02.522072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:20:02.522072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:20:02.522072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:20:02.522072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 2c34f05634d34da29088bcf75069958d Jun 16 16:20:02.522072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeNegativeTest-939462868-project Jun 16 16:20:02.522072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:20:02.522072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. Jun 16 16:20:02.522072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': 'e263395e-8f5e-4b76-85de-41bf42f947ae'} Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:20:02.522861 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. Jun 16 16:20:02.524222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:02.525634 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1c7570c2-4284-46f2-aa2e-0d6d2e4edf01 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] Returning 404 to user: Instance e263395e-8f5e-4b76-85de-41bf42f947ae could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:20:02.525634 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1c7570c2-4284-46f2-aa2e-0d6d2e4edf01 tempest-AttachVolumeNegativeTest-939462868 tempest-AttachVolumeNegativeTest-939462868-project] 10.222.0.17 "GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae" status: 404 len: 111 microversion: 2.1 time: 0.031685 Jun 16 16:20:02.525634 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 405/820] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:02 2022] GET /compute/v2.1/servers/e263395e-8f5e-4b76-85de-41bf42f947ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:20:02.612606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-2ca91c45-57cb-4ddd-8f06-95f82a6c232e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:02.613543 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2ca91c45-57cb-4ddd-8f06-95f82a6c232e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:02.619869 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2ca91c45-57cb-4ddd-8f06-95f82a6c232e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.620316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2ca91c45-57cb-4ddd-8f06-95f82a6c232e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.621390 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2ca91c45-57cb-4ddd-8f06-95f82a6c232e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.621516 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2ca91c45-57cb-4ddd-8f06-95f82a6c232e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.653070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-2ca91c45-57cb-4ddd-8f06-95f82a6c232e tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044572 Jun 16 16:20:02.653820 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 416/821] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:20:02 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:02.797283 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-dadbaadf-1b4c-4870-b114-7b1b1080c36a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:02.797783 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-dadbaadf-1b4c-4870-b114-7b1b1080c36a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:02.804641 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dadbaadf-1b4c-4870-b114-7b1b1080c36a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.805127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dadbaadf-1b4c-4870-b114-7b1b1080c36a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.805907 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dadbaadf-1b4c-4870-b114-7b1b1080c36a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.806449 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-dadbaadf-1b4c-4870-b114-7b1b1080c36a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.839080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-dadbaadf-1b4c-4870-b114-7b1b1080c36a tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments/beba1b15-c611-464e-9e99-cc2b2d6de0f8" status: 200 len: 194 microversion: 2.1 time: 0.046055 Jun 16 16:20:02.839689 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 406/822] 10.222.0.17 () {58 vars in 1412 bytes} [Thu Jun 16 16:20:02 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments/beba1b15-c611-464e-9e99-cc2b2d6de0f8 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:02.849798 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4e4736b2-6f82-4c93-8a33-0296efcd8e24 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:02.850330 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4e4736b2-6f82-4c93-8a33-0296efcd8e24 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:02.857079 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4e4736b2-6f82-4c93-8a33-0296efcd8e24 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.857572 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4e4736b2-6f82-4c93-8a33-0296efcd8e24 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.858483 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4e4736b2-6f82-4c93-8a33-0296efcd8e24 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.858926 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4e4736b2-6f82-4c93-8a33-0296efcd8e24 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.960988 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-4e4736b2-6f82-4c93-8a33-0296efcd8e24 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lazy-loading 'services' on Instance uuid d61ad4f5-127e-4836-ad7c-75ae01179424 {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:20:03.043047 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4e4736b2-6f82-4c93-8a33-0296efcd8e24 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments/beba1b15-c611-464e-9e99-cc2b2d6de0f8" status: 202 len: 0 microversion: 2.1 time: 0.197091 Jun 16 16:20:03.043643 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 417/823] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 16:20:02 2022] DELETE /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments/beba1b15-c611-464e-9e99-cc2b2d6de0f8 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:20:04.171044 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f8c44bc1-46ca-449e-a771-eaa2a2735e54 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:04.171835 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f8c44bc1-46ca-449e-a771-eaa2a2735e54 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:04.174500 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:04.179804 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f8c44bc1-46ca-449e-a771-eaa2a2735e54 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:04.180247 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f8c44bc1-46ca-449e-a771-eaa2a2735e54 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:04.181051 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f8c44bc1-46ca-449e-a771-eaa2a2735e54 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:04.181457 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f8c44bc1-46ca-449e-a771-eaa2a2735e54 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:04.213764 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f8c44bc1-46ca-449e-a771-eaa2a2735e54 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments/c427a865-1d0b-4725-bace-2245efc3b866" status: 200 len: 194 microversion: 2.1 time: 0.046793 Jun 16 16:20:04.216345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 407/824] 10.222.0.17 () {58 vars in 1412 bytes} [Thu Jun 16 16:20:04 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments/c427a865-1d0b-4725-bace-2245efc3b866 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:04.226197 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-77e54b15-53dd-4014-824f-44e321b3fa66 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:04.226798 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-77e54b15-53dd-4014-824f-44e321b3fa66 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:04.233075 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77e54b15-53dd-4014-824f-44e321b3fa66 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:04.233557 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77e54b15-53dd-4014-824f-44e321b3fa66 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:04.234613 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77e54b15-53dd-4014-824f-44e321b3fa66 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:04.235106 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77e54b15-53dd-4014-824f-44e321b3fa66 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:04.323943 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-77e54b15-53dd-4014-824f-44e321b3fa66 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lazy-loading 'services' on Instance uuid d61ad4f5-127e-4836-ad7c-75ae01179424 {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:20:04.410627 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-77e54b15-53dd-4014-824f-44e321b3fa66 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments/c427a865-1d0b-4725-bace-2245efc3b866" status: 202 len: 0 microversion: 2.1 time: 0.189095 Jun 16 16:20:04.411695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 418/825] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 16:20:04 2022] DELETE /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments/c427a865-1d0b-4725-bace-2245efc3b866 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:20:05.610133 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8ecafe0a-6e7b-4f9f-b459-b3d94607b7a8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:05.611026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8ecafe0a-6e7b-4f9f-b459-b3d94607b7a8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:05.620064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8ecafe0a-6e7b-4f9f-b459-b3d94607b7a8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:05.620520 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8ecafe0a-6e7b-4f9f-b459-b3d94607b7a8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:05.621310 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8ecafe0a-6e7b-4f9f-b459-b3d94607b7a8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:05.621868 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8ecafe0a-6e7b-4f9f-b459-b3d94607b7a8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:05.655591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8ecafe0a-6e7b-4f9f-b459-b3d94607b7a8 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051096 Jun 16 16:20:05.656767 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 408/826] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:20:05 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:20:05.784261 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3cbebac5-362d-4e7e-b4c8-c015947587e2 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:05.785462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3cbebac5-362d-4e7e-b4c8-c015947587e2 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:05.793661 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3cbebac5-362d-4e7e-b4c8-c015947587e2 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:05.794150 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3cbebac5-362d-4e7e-b4c8-c015947587e2 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:05.794952 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3cbebac5-362d-4e7e-b4c8-c015947587e2 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:05.795396 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3cbebac5-362d-4e7e-b4c8-c015947587e2 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:05.834382 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3cbebac5-362d-4e7e-b4c8-c015947587e2 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058289 Jun 16 16:20:05.834966 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 419/827] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 16:20:05 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:20:05.900795 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-aad3411d-05fe-4575-b104-c5a175fa9aea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:05.901298 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-aad3411d-05fe-4575-b104-c5a175fa9aea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:05.909368 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aad3411d-05fe-4575-b104-c5a175fa9aea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:05.910104 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aad3411d-05fe-4575-b104-c5a175fa9aea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:05.910896 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aad3411d-05fe-4575-b104-c5a175fa9aea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:05.911335 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aad3411d-05fe-4575-b104-c5a175fa9aea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:05.939547 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-aad3411d-05fe-4575-b104-c5a175fa9aea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:20:06.036677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-aad3411d-05fe-4575-b104-c5a175fa9aea tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 204 len: 0 microversion: 2.1 time: 0.139336 Jun 16 16:20:06.040561 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 409/828] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:20:05 2022] DELETE /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:20:06.047613 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-01e09c0b-deb8-4876-bf50-2f9cc7f67ed0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:06.054063 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-01e09c0b-deb8-4876-bf50-2f9cc7f67ed0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:06.068298 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-01e09c0b-deb8-4876-bf50-2f9cc7f67ed0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:06.069112 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-01e09c0b-deb8-4876-bf50-2f9cc7f67ed0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:06.070564 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-01e09c0b-deb8-4876-bf50-2f9cc7f67ed0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:06.074017 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-01e09c0b-deb8-4876-bf50-2f9cc7f67ed0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:06.259065 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-01e09c0b-deb8-4876-bf50-2f9cc7f67ed0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:06.271664 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-01e09c0b-deb8-4876-bf50-2f9cc7f67ed0 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1674 microversion: 2.1 time: 0.229657 Jun 16 16:20:06.272541 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 420/829] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:06 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1674 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:07.303797 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a5744a2f-9c37-467a-9607-6da5be826d95 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:07.304610 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a5744a2f-9c37-467a-9607-6da5be826d95 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:07.311498 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a5744a2f-9c37-467a-9607-6da5be826d95 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:07.312687 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a5744a2f-9c37-467a-9607-6da5be826d95 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:07.313472 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a5744a2f-9c37-467a-9607-6da5be826d95 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:07.313906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a5744a2f-9c37-467a-9607-6da5be826d95 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:07.472683 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a5744a2f-9c37-467a-9607-6da5be826d95 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:07.494862 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a5744a2f-9c37-467a-9607-6da5be826d95 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1674 microversion: 2.1 time: 0.198702 Jun 16 16:20:07.495459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 410/830] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:07 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1674 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:08.516892 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4e21ea84-e44b-4bf8-9761-772fc35c2653 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:08.517827 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4e21ea84-e44b-4bf8-9761-772fc35c2653 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:08.524989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4e21ea84-e44b-4bf8-9761-772fc35c2653 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:08.525848 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4e21ea84-e44b-4bf8-9761-772fc35c2653 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:08.526866 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4e21ea84-e44b-4bf8-9761-772fc35c2653 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:08.527383 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4e21ea84-e44b-4bf8-9761-772fc35c2653 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:08.826506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4e21ea84-e44b-4bf8-9761-772fc35c2653 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:08.836611 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4e21ea84-e44b-4bf8-9761-772fc35c2653 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1674 microversion: 2.1 time: 0.323983 Jun 16 16:20:08.846065 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 421/831] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:08 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1674 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:09.403462 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-2e6c5ca3-a739-4d32-beb9-995cf24eb07f req-35fda8fe-28da-4027-be4c-1f669abab3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61ad4f5-127e-4836-ad7c-75ae01179424", "name": "network-vif-deleted", "tag": "345d7505-2303-4cf6-ac18-5979aa4955be"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:09.416625 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-2e6c5ca3-a739-4d32-beb9-995cf24eb07f req-35fda8fe-28da-4027-be4c-1f669abab3e4 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:09.417139 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-2e6c5ca3-a739-4d32-beb9-995cf24eb07f req-35fda8fe-28da-4027-be4c-1f669abab3e4 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:09.434213 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-2e6c5ca3-a739-4d32-beb9-995cf24eb07f req-35fda8fe-28da-4027-be4c-1f669abab3e4 service nova] Creating event network-vif-deleted:345d7505-2303-4cf6-ac18-5979aa4955be for instance d61ad4f5-127e-4836-ad7c-75ae01179424 on hv-cinder-83716 Jun 16 16:20:09.440685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-2e6c5ca3-a739-4d32-beb9-995cf24eb07f req-35fda8fe-28da-4027-be4c-1f669abab3e4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047071 Jun 16 16:20:09.442048 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 411/832] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:09.856323 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-99c5b6c9-8b67-4ccc-8904-00ee009536e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:09.857125 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-99c5b6c9-8b67-4ccc-8904-00ee009536e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:09.865211 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-99c5b6c9-8b67-4ccc-8904-00ee009536e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:09.865672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-99c5b6c9-8b67-4ccc-8904-00ee009536e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:09.866723 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-99c5b6c9-8b67-4ccc-8904-00ee009536e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:09.867426 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-99c5b6c9-8b67-4ccc-8904-00ee009536e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:09.923225 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-99c5b6c9-8b67-4ccc-8904-00ee009536e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:09.924685 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-99c5b6c9-8b67-4ccc-8904-00ee009536e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:09.924685 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-99c5b6c9-8b67-4ccc-8904-00ee009536e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lazy-loading 'fault' on Instance uuid d61ad4f5-127e-4836-ad7c-75ae01179424 {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:20:09.982644 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-99c5b6c9-8b67-4ccc-8904-00ee009536e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80386d7afc994931af05fd49fa8043d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34323d7e571b4f1db4d6e0c6cd1159cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:09.991978 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-99c5b6c9-8b67-4ccc-8904-00ee009536e6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 200 len: 1328 microversion: 2.1 time: 0.139889 Jun 16 16:20:09.994329 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 422/833] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:09 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 1328 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:20:11.010936 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-df680761-f692-4469-af43-1cc64d68011c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:11.011770 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-df680761-f692-4469-af43-1cc64d68011c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:11.019141 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df680761-f692-4469-af43-1cc64d68011c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:11.019646 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df680761-f692-4469-af43-1cc64d68011c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:11.020497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df680761-f692-4469-af43-1cc64d68011c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:11.021062 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df680761-f692-4469-af43-1cc64d68011c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:11.035777 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-df680761-f692-4469-af43-1cc64d68011c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] HTTP exception thrown: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-df680761-f692-4469-af43-1cc64d68011c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Request method failure captured: Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 HTTP/1.1 Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ZRrQp__f6SLjqkoqjcqf5q2cHKur69wKGyf-JZAkh2Osl2zjbqWmQ87ZwE5jD4g09TAMOuP_NMdYQwfLAtXKqvkmrY835B_C87-j943ATc5vqTteguBtYpVP6ouGL5hoKOVTg16H6Yvm6-Pf5EsAbCnDkwS4RGY3rxnfBY3D42i0M Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 34323d7e571b4f1db4d6e0c6cd1159cc Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:20:11.037597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:20:11.039345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34323d7e571b4f1db4d6e0c6cd1159cc"}]}] Jun 16 16:20:11.039345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:20:11.039345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 34323d7e571b4f1db4d6e0c6cd1159cc Jun 16 16:20:11.039345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:20:11.039345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeTestJSON-1247911332-project Jun 16 16:20:11.039345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:20:11.039345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:20:11.039345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 80386d7afc994931af05fd49fa8043d6 Jun 16 16:20:11.039345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeTestJSON-1247911332-project Jun 16 16:20:11.039345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:20:11.039345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. Jun 16 16:20:11.039345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': 'd61ad4f5-127e-4836-ad7c-75ae01179424'} Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:20:11.044116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. Jun 16 16:20:11.045647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:11.047377 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-df680761-f692-4469-af43-1cc64d68011c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Returning 404 to user: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:20:11.047377 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-df680761-f692-4469-af43-1cc64d68011c tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 404 len: 111 microversion: 2.1 time: 0.032980 Jun 16 16:20:11.047377 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 412/834] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:11 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:20:11.048485 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-69d712ae-e989-47d6-8cc2-b2b28ed64116 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '.version_select at 0x7f38bb524dc0>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:11.068130 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-69d712ae-e989-47d6-8cc2-b2b28ed64116 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921607216" status: 202 len: 0 microversion: 2.1 time: 0.023368 Jun 16 16:20:11.068999 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 423/835] 10.222.0.17 () {58 vars in 1220 bytes} [Thu Jun 16 16:20:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921607216 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:20:14.079552 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c0cd2b9f-5561-48f8-9010-888907f0e0cd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:14.080080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c0cd2b9f-5561-48f8-9010-888907f0e0cd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:14.086622 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c0cd2b9f-5561-48f8-9010-888907f0e0cd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:14.087075 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c0cd2b9f-5561-48f8-9010-888907f0e0cd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:14.087849 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c0cd2b9f-5561-48f8-9010-888907f0e0cd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:14.088287 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c0cd2b9f-5561-48f8-9010-888907f0e0cd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:14.104287 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-c0cd2b9f-5561-48f8-9010-888907f0e0cd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] HTTP exception thrown: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c0cd2b9f-5561-48f8-9010-888907f0e0cd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Request method failure captured: Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: DELETE /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 HTTP/1.1 Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ZRrQp__f6SLjqkoqjcqf5q2cHKur69wKGyf-JZAkh2Osl2zjbqWmQ87ZwE5jD4g09TAMOuP_NMdYQwfLAtXKqvkmrY835B_C87-j943ATc5vqTteguBtYpVP6ouGL5hoKOVTg16H6Yvm6-Pf5EsAbCnDkwS4RGY3rxnfBY3D42i0M Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 34323d7e571b4f1db4d6e0c6cd1159cc Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:20:14.105836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:20:14.107360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34323d7e571b4f1db4d6e0c6cd1159cc"}]}] Jun 16 16:20:14.107360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:20:14.107360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 34323d7e571b4f1db4d6e0c6cd1159cc Jun 16 16:20:14.107360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:20:14.107360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeTestJSON-1247911332-project Jun 16 16:20:14.107360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:20:14.107360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:20:14.107360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 80386d7afc994931af05fd49fa8043d6 Jun 16 16:20:14.107360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeTestJSON-1247911332-project Jun 16 16:20:14.107360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:20:14.107360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. Jun 16 16:20:14.107360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': 'd61ad4f5-127e-4836-ad7c-75ae01179424'} Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:20:14.108384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. Jun 16 16:20:14.110411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:14.111982 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c0cd2b9f-5561-48f8-9010-888907f0e0cd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Returning 404 to user: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:20:14.111982 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c0cd2b9f-5561-48f8-9010-888907f0e0cd tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 404 len: 111 microversion: 2.1 time: 0.032497 Jun 16 16:20:14.111982 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 413/836] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:20:14 2022] DELETE /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:20:14.118924 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c754b42d-0110-4b71-b43c-6a3314c588f6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:14.119545 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c754b42d-0110-4b71-b43c-6a3314c588f6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: d61ad4f5-127e-4836-ad7c-75ae01179424] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:14.126447 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c754b42d-0110-4b71-b43c-6a3314c588f6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:14.126904 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c754b42d-0110-4b71-b43c-6a3314c588f6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:14.128009 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c754b42d-0110-4b71-b43c-6a3314c588f6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:14.128156 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c754b42d-0110-4b71-b43c-6a3314c588f6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:14.144694 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-c754b42d-0110-4b71-b43c-6a3314c588f6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] HTTP exception thrown: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c754b42d-0110-4b71-b43c-6a3314c588f6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Request method failure captured: Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 HTTP/1.1 Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ZRrQp__f6SLjqkoqjcqf5q2cHKur69wKGyf-JZAkh2Osl2zjbqWmQ87ZwE5jD4g09TAMOuP_NMdYQwfLAtXKqvkmrY835B_C87-j943ATc5vqTteguBtYpVP6ouGL5hoKOVTg16H6Yvm6-Pf5EsAbCnDkwS4RGY3rxnfBY3D42i0M Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 34323d7e571b4f1db4d6e0c6cd1159cc Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:20:14.146449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:20:14.147919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34323d7e571b4f1db4d6e0c6cd1159cc"}]}] Jun 16 16:20:14.147919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:20:14.147919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 34323d7e571b4f1db4d6e0c6cd1159cc Jun 16 16:20:14.147919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:20:14.147919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-AttachVolumeTestJSON-1247911332-project Jun 16 16:20:14.147919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:20:14.147919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:20:14.147919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 80386d7afc994931af05fd49fa8043d6 Jun 16 16:20:14.147919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-AttachVolumeTestJSON-1247911332-project Jun 16 16:20:14.147919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:20:14.147919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. Jun 16 16:20:14.147919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': 'd61ad4f5-127e-4836-ad7c-75ae01179424'} Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:20:14.149139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. Jun 16 16:20:14.150630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:14.152510 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c754b42d-0110-4b71-b43c-6a3314c588f6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Returning 404 to user: Instance d61ad4f5-127e-4836-ad7c-75ae01179424 could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:20:14.152510 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c754b42d-0110-4b71-b43c-6a3314c588f6 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424" status: 404 len: 111 microversion: 2.1 time: 0.033429 Jun 16 16:20:14.152510 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 424/837] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:14 2022] GET /compute/v2.1/servers/d61ad4f5-127e-4836-ad7c-75ae01179424 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:20:15.295724 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-44cf2bcb-08e0-476c-b7c0-1dc311981bc7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:15.297177 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-44cf2bcb-08e0-476c-b7c0-1dc311981bc7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:15.303123 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-44cf2bcb-08e0-476c-b7c0-1dc311981bc7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:15.303573 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-44cf2bcb-08e0-476c-b7c0-1dc311981bc7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:15.304347 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-44cf2bcb-08e0-476c-b7c0-1dc311981bc7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:15.304788 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-44cf2bcb-08e0-476c-b7c0-1dc311981bc7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:15.319136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-44cf2bcb-08e0-476c-b7c0-1dc311981bc7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] HTTP exception thrown: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-44cf2bcb-08e0-476c-b7c0-1dc311981bc7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Request method failure captured: Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: DELETE /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb HTTP/1.1 Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ZRrQp__f6SLjqkoqjcqf5q2cHKur69wKGyf-JZAkh2Osl2zjbqWmQ87ZwE5jD4g09TAMOuP_NMdYQwfLAtXKqvkmrY835B_C87-j943ATc5vqTteguBtYpVP6ouGL5hoKOVTg16H6Yvm6-Pf5EsAbCnDkwS4RGY3rxnfBY3D42i0M Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 34323d7e571b4f1db4d6e0c6cd1159cc Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:20:15.320674 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:20:15.322256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34323d7e571b4f1db4d6e0c6cd1159cc"}]}] Jun 16 16:20:15.322256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:20:15.322256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 34323d7e571b4f1db4d6e0c6cd1159cc Jun 16 16:20:15.322256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:20:15.322256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeTestJSON-1247911332-project Jun 16 16:20:15.322256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:20:15.322256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:20:15.322256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 80386d7afc994931af05fd49fa8043d6 Jun 16 16:20:15.322256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeTestJSON-1247911332-project Jun 16 16:20:15.322256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:20:15.322256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. Jun 16 16:20:15.322256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': '6b69f513-c146-469b-9045-a974844f18cb'} Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:20:15.323118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. Jun 16 16:20:15.324503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:20:15.326047 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-44cf2bcb-08e0-476c-b7c0-1dc311981bc7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Returning 404 to user: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:20:15.326047 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-44cf2bcb-08e0-476c-b7c0-1dc311981bc7 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 404 len: 111 microversion: 2.1 time: 0.030220 Jun 16 16:20:15.326047 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 414/838] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:20:15 2022] DELETE /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:20:15.331859 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e427840a-821d-4e83-bcca-ffe5c3d55357 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:15.332482 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e427840a-821d-4e83-bcca-ffe5c3d55357 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] [instance: 6b69f513-c146-469b-9045-a974844f18cb] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:15.339373 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e427840a-821d-4e83-bcca-ffe5c3d55357 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:15.339680 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e427840a-821d-4e83-bcca-ffe5c3d55357 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:15.340491 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e427840a-821d-4e83-bcca-ffe5c3d55357 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:15.340902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e427840a-821d-4e83-bcca-ffe5c3d55357 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:15.514455 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-e427840a-821d-4e83-bcca-ffe5c3d55357 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] HTTP exception thrown: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e427840a-821d-4e83-bcca-ffe5c3d55357 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Request method failure captured: Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb HTTP/1.1 Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ZRrQp__f6SLjqkoqjcqf5q2cHKur69wKGyf-JZAkh2Osl2zjbqWmQ87ZwE5jD4g09TAMOuP_NMdYQwfLAtXKqvkmrY835B_C87-j943ATc5vqTteguBtYpVP6ouGL5hoKOVTg16H6Yvm6-Pf5EsAbCnDkwS4RGY3rxnfBY3D42i0M Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 34323d7e571b4f1db4d6e0c6cd1159cc Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:20:15.517959 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:20:15.520111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/34323d7e571b4f1db4d6e0c6cd1159cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34323d7e571b4f1db4d6e0c6cd1159cc"}]}] Jun 16 16:20:15.520111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:20:15.520111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 34323d7e571b4f1db4d6e0c6cd1159cc Jun 16 16:20:15.520111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1247911332 Jun 16 16:20:15.520111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-AttachVolumeTestJSON-1247911332-project Jun 16 16:20:15.520111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:20:15.520111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:20:15.520111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 80386d7afc994931af05fd49fa8043d6 Jun 16 16:20:15.520111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-AttachVolumeTestJSON-1247911332-project Jun 16 16:20:15.520111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:20:15.520111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. Jun 16 16:20:15.520111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': '6b69f513-c146-469b-9045-a974844f18cb'} Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:20:15.520989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. Jun 16 16:20:15.522532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:15.523935 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e427840a-821d-4e83-bcca-ffe5c3d55357 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] Returning 404 to user: Instance 6b69f513-c146-469b-9045-a974844f18cb could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:20:15.523935 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e427840a-821d-4e83-bcca-ffe5c3d55357 tempest-AttachVolumeTestJSON-1247911332 tempest-AttachVolumeTestJSON-1247911332-project] 10.222.0.17 "GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb" status: 404 len: 111 microversion: 2.1 time: 0.193101 Jun 16 16:20:15.526079 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 425/839] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:15 2022] GET /compute/v2.1/servers/6b69f513-c146-469b-9045-a974844f18cb => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:20:22.374041 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-615a878a-84bb-4f5e-a584-997a3d7d08dc tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] Calling method '.version_select at 0x7f38bb3cc1f0>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:22.430077 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-615a878a-84bb-4f5e-a584-997a3d7d08dc tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/9e9a64bb-4934-4416-971c-02febb266e44" status: 200 len: 350 microversion: 2.1 time: 0.059864 Jun 16 16:20:22.430954 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 415/840] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:20:22 2022] GET /compute/v2.1/os-volumes/9e9a64bb-4934-4416-971c-02febb266e44 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:23.803145 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4777c107-91f1-419c-a61e-7098aaa58037 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] Calling method '.version_select at 0x7f38bb4cee50>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:23.852828 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4777c107-91f1-419c-a61e-7098aaa58037 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b7d63411-038f-4345-97bd-1946fbf0bc13" status: 200 len: 350 microversion: 2.1 time: 0.055424 Jun 16 16:20:23.853380 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 426/841] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:20:23 2022] GET /compute/v2.1/os-volumes/b7d63411-038f-4345-97bd-1946fbf0bc13 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:25.240880 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e387d97a-672a-49ee-8977-96e704e8d899 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] Calling method '.version_select at 0x7f38bb3d2790>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:25.301257 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:25.308589 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e387d97a-672a-49ee-8977-96e704e8d899 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ead45cc8-e7f3-4a60-b2d9-85bfbc2d0c47" status: 200 len: 351 microversion: 2.1 time: 0.072079 Jun 16 16:20:25.309153 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 416/842] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:20:25 2022] GET /compute/v2.1/os-volumes/ead45cc8-e7f3-4a60-b2d9-85bfbc2d0c47 => generated 351 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:25.321446 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1a9e1156-16f8-4caa-ba5e-09f8211be6ef tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] Calling method '.version_select at 0x7f38bb4ce9d0>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:25.337987 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:25.346032 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:25.420263 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1a9e1156-16f8-4caa-ba5e-09f8211be6ef tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.101971 Jun 16 16:20:25.421640 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 427/843] 10.222.0.17 () {58 vars in 1133 bytes} [Thu Jun 16 16:20:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:25.434982 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:25.436083 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-25bc94f4-76c8-4441-967b-9ef9f5adbe61 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] Calling method '.version_select at 0x7f38bb3cc310>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:25.523749 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-25bc94f4-76c8-4441-967b-9ef9f5adbe61 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092733 Jun 16 16:20:25.524411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 417/844] 10.222.0.17 () {58 vars in 1148 bytes} [Thu Jun 16 16:20:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:25.538079 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a86c1ecd-de23-49ef-a562-3f41c13b37b2 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] Calling method '.version_select at 0x7f38bb584700>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:25.632714 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a86c1ecd-de23-49ef-a562-3f41c13b37b2 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.099147 Jun 16 16:20:25.633272 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 428/845] 10.222.0.17 () {58 vars in 1133 bytes} [Thu Jun 16 16:20:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:25.646452 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-57041ecf-0544-4fa3-8d36-1e25c7bb12a2 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] Calling method '.version_select at 0x7f38bb4335e0>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:25.735539 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-57041ecf-0544-4fa3-8d36-1e25c7bb12a2 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092843 Jun 16 16:20:25.736103 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 418/846] 10.222.0.17 () {58 vars in 1166 bytes} [Thu Jun 16 16:20:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:25.748685 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-160d0b24-1ae3-4925-81b9-daadb27fb687 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] Calling method '.version_select at 0x7f38bb50d3a0>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:25.837873 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-160d0b24-1ae3-4925-81b9-daadb27fb687 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093434 Jun 16 16:20:25.838515 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 429/847] 10.222.0.17 () {58 vars in 1169 bytes} [Thu Jun 16 16:20:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:25.851170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9a8c907f-9297-4cef-8fd0-0966c1317686 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] Calling method '.version_select at 0x7f38bb3d2940>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:25.937696 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9a8c907f-9297-4cef-8fd0-0966c1317686 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.090101 Jun 16 16:20:25.941992 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 419/848] 10.222.0.17 () {58 vars in 1154 bytes} [Thu Jun 16 16:20:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:25.954246 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-17b8d866-9e14-43d9-817a-a14db537e1a5 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] Calling method '.version_select at 0x7f38bb4cea60>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:26.045160 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-17b8d866-9e14-43d9-817a-a14db537e1a5 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.095775 Jun 16 16:20:26.045835 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 430/849] 10.222.0.17 () {58 vars in 1187 bytes} [Thu Jun 16 16:20:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:26.057621 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-821591e2-5270-4bae-8423-9f939362c0d9 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] Calling method '.version_select at 0x7f38bb4bb3a0>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:26.144180 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-821591e2-5270-4bae-8423-9f939362c0d9 tempest-VolumesTestJSON-2081585457 tempest-VolumesTestJSON-2081585457-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.090212 Jun 16 16:20:26.145320 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 420/850] 10.222.0.17 () {58 vars in 1154 bytes} [Thu Jun 16 16:20:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:28.521680 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1075213845", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452"}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:28.579954 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.network.neutron [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] validate_networks() for None {{(pid=117756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:20:28.896993 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Flavor limits 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:20:28.897414 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Image limits 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:20:28.897906 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Flavor pref 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:20:28.898362 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Image pref 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:20:28.898861 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:20:28.909817 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:28.910291 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:28.911083 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:28.911512 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:28.928543 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Getting quotas for project 765cab7190f642e891d2e7236edc3a8a. Resources: {'instances', 'cores', 'ram'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:20:28.932452 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Getting quotas for user a76571e533064b1ba007b5d1a025c3cf and project 765cab7190f642e891d2e7236edc3a8a. Resources: {'instances', 'cores', 'ram'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:20:28.943767 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Going to run 1 instances... {{(pid=117756) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:20:28.946021 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:20:28.991339 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-9fdfdec5-ff92-44f9-9876-7eb730fba1cb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.474667 Jun 16 16:20:28.991977 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 431/851] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:20:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:20:29.003121 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e57a8ef2-8dee-4a33-b07a-f38cea054d5e tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:29.003731 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e57a8ef2-8dee-4a33-b07a-f38cea054d5e tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:29.059031 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e57a8ef2-8dee-4a33-b07a-f38cea054d5e tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76571e533064b1ba007b5d1a025c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765cab7190f642e891d2e7236edc3a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:29.068271 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e57a8ef2-8dee-4a33-b07a-f38cea054d5e tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] 10.222.0.17 "GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2" status: 200 len: 1215 microversion: 2.1 time: 0.070294 Jun 16 16:20:29.068953 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 421/852] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:28 2022] GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:30.069857 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f31f1613-d2a5-4dc6-b97c-6431ba06cf69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:30.070467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f31f1613-d2a5-4dc6-b97c-6431ba06cf69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:30.078521 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f31f1613-d2a5-4dc6-b97c-6431ba06cf69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:30.079100 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f31f1613-d2a5-4dc6-b97c-6431ba06cf69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:30.081024 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f31f1613-d2a5-4dc6-b97c-6431ba06cf69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:30.081024 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f31f1613-d2a5-4dc6-b97c-6431ba06cf69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:30.086944 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1c6f359d-ed69-4145-b915-7afe2a620ccb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:30.087665 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1c6f359d-ed69-4145-b915-7afe2a620ccb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:30.097914 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c6f359d-ed69-4145-b915-7afe2a620ccb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:30.101198 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c6f359d-ed69-4145-b915-7afe2a620ccb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:30.102195 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c6f359d-ed69-4145-b915-7afe2a620ccb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:30.104017 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c6f359d-ed69-4145-b915-7afe2a620ccb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:30.142128 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f31f1613-d2a5-4dc6-b97c-6431ba06cf69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/ips" status: 200 len: 151 microversion: 2.20 time: 0.079913 Jun 16 16:20:30.143188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 432/853] 10.222.0.17 () {60 vars in 1288 bytes} [Thu Jun 16 16:20:30 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/ips => generated 151 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 16:20:30.207223 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1c6f359d-ed69-4145-b915-7afe2a620ccb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76571e533064b1ba007b5d1a025c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765cab7190f642e891d2e7236edc3a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:30.215480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1c6f359d-ed69-4145-b915-7afe2a620ccb tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] 10.222.0.17 "GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2" status: 200 len: 1273 microversion: 2.1 time: 0.132274 Jun 16 16:20:30.216720 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 422/854] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:30 2022] GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2 => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:31.236326 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a2b82173-f93d-4a7f-bfb9-d78acf8dca2a tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:31.236943 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a2b82173-f93d-4a7f-bfb9-d78acf8dca2a tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:31.245630 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a2b82173-f93d-4a7f-bfb9-d78acf8dca2a tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:31.246102 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a2b82173-f93d-4a7f-bfb9-d78acf8dca2a tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:31.247099 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a2b82173-f93d-4a7f-bfb9-d78acf8dca2a tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:31.247531 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a2b82173-f93d-4a7f-bfb9-d78acf8dca2a tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:31.507048 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a2b82173-f93d-4a7f-bfb9-d78acf8dca2a tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76571e533064b1ba007b5d1a025c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765cab7190f642e891d2e7236edc3a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:31.518026 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a2b82173-f93d-4a7f-bfb9-d78acf8dca2a tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] 10.222.0.17 "GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2" status: 200 len: 1315 microversion: 2.1 time: 0.286062 Jun 16 16:20:31.518026 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 433/855] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:31 2022] GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:32.007546 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-1296e860-69a9-4da6-80f9-21209416029d req-35c1af14-b491-49a2-be3d-266d26060ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "199573a7-8f1c-4242-998f-cd6a0b8270b2", "tag": "31d9ee25-8948-4ebc-ac9c-b38c825d2c60"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:32.029605 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-1296e860-69a9-4da6-80f9-21209416029d req-35c1af14-b491-49a2-be3d-266d26060ef8 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:32.030698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-1296e860-69a9-4da6-80f9-21209416029d req-35c1af14-b491-49a2-be3d-266d26060ef8 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:32.044711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-1296e860-69a9-4da6-80f9-21209416029d req-35c1af14-b491-49a2-be3d-266d26060ef8 service nova] Creating event network-changed:31d9ee25-8948-4ebc-ac9c-b38c825d2c60 for instance 199573a7-8f1c-4242-998f-cd6a0b8270b2 on hv-cinder-83716 Jun 16 16:20:32.049969 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-1296e860-69a9-4da6-80f9-21209416029d req-35c1af14-b491-49a2-be3d-266d26060ef8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046763 Jun 16 16:20:32.050918 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 423/856] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:32.070676 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-336c14a5-d9ed-40df-a73e-9cee7b5f44b4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:32.071550 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-336c14a5-d9ed-40df-a73e-9cee7b5f44b4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:32.080082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-336c14a5-d9ed-40df-a73e-9cee7b5f44b4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:32.080682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-336c14a5-d9ed-40df-a73e-9cee7b5f44b4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:32.081572 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-336c14a5-d9ed-40df-a73e-9cee7b5f44b4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:32.082293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-336c14a5-d9ed-40df-a73e-9cee7b5f44b4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:32.110043 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-336c14a5-d9ed-40df-a73e-9cee7b5f44b4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lazy-loading 'flavor' on Instance uuid 4412fc83-e558-4531-8295-ee5a4f1ba983 {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:20:32.470327 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-336c14a5-d9ed-40df-a73e-9cee7b5f44b4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "POST /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/action" status: 202 len: 0 microversion: 2.20 time: 0.404041 Jun 16 16:20:32.471332 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 434/857] 10.222.0.17 () {62 vars in 1318 bytes} [Thu Jun 16 16:20:32 2022] POST /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:20:32.482019 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b994b97c-d6c7-421f-913a-4b18d45e2c54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:32.483606 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b994b97c-d6c7-421f-913a-4b18d45e2c54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:32.491844 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b994b97c-d6c7-421f-913a-4b18d45e2c54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:32.492532 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b994b97c-d6c7-421f-913a-4b18d45e2c54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:32.493304 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b994b97c-d6c7-421f-913a-4b18d45e2c54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:32.493734 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b994b97c-d6c7-421f-913a-4b18d45e2c54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:32.535273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4fd3579f-0577-4a88-8bd8-ddc3b7a6878f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:32.536199 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4fd3579f-0577-4a88-8bd8-ddc3b7a6878f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:32.544089 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4fd3579f-0577-4a88-8bd8-ddc3b7a6878f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:32.544544 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4fd3579f-0577-4a88-8bd8-ddc3b7a6878f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:32.545412 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4fd3579f-0577-4a88-8bd8-ddc3b7a6878f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:32.546113 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4fd3579f-0577-4a88-8bd8-ddc3b7a6878f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:32.677814 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b994b97c-d6c7-421f-913a-4b18d45e2c54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:32.687563 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b994b97c-d6c7-421f-913a-4b18d45e2c54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:32.689239 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b994b97c-d6c7-421f-913a-4b18d45e2c54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:32.690566 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b994b97c-d6c7-421f-913a-4b18d45e2c54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.214813 Jun 16 16:20:32.691882 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 424/858] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:32 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:32.755019 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4fd3579f-0577-4a88-8bd8-ddc3b7a6878f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76571e533064b1ba007b5d1a025c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765cab7190f642e891d2e7236edc3a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:32.768152 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4fd3579f-0577-4a88-8bd8-ddc3b7a6878f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] 10.222.0.17 "GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2" status: 200 len: 1315 microversion: 2.1 time: 0.238158 Jun 16 16:20:32.769056 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 435/859] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:32 2022] GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:33.712372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-34c43d28-853a-4f51-a017-9443939b3743 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:33.713071 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-34c43d28-853a-4f51-a017-9443939b3743 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:33.720291 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-34c43d28-853a-4f51-a017-9443939b3743 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:33.720743 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-34c43d28-853a-4f51-a017-9443939b3743 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:33.723252 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-34c43d28-853a-4f51-a017-9443939b3743 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:33.723252 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-34c43d28-853a-4f51-a017-9443939b3743 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:33.801617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fae50da1-4b5d-47d8-aab4-7830fa987343 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:33.802365 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-fae50da1-4b5d-47d8-aab4-7830fa987343 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:33.810245 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fae50da1-4b5d-47d8-aab4-7830fa987343 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:33.811479 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fae50da1-4b5d-47d8-aab4-7830fa987343 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:33.812563 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fae50da1-4b5d-47d8-aab4-7830fa987343 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:33.813256 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fae50da1-4b5d-47d8-aab4-7830fa987343 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:33.896096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-34c43d28-853a-4f51-a017-9443939b3743 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:33.914377 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-34c43d28-853a-4f51-a017-9443939b3743 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:33.915923 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-34c43d28-853a-4f51-a017-9443939b3743 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:33.917790 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-34c43d28-853a-4f51-a017-9443939b3743 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.210387 Jun 16 16:20:33.918840 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 425/860] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:33 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:34.055074 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fae50da1-4b5d-47d8-aab4-7830fa987343 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76571e533064b1ba007b5d1a025c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765cab7190f642e891d2e7236edc3a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:34.063937 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fae50da1-4b5d-47d8-aab4-7830fa987343 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] 10.222.0.17 "GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2" status: 200 len: 1315 microversion: 2.1 time: 0.281191 Jun 16 16:20:34.064866 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 436/861] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:33 2022] GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:34.940184 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-80fce3cb-b5fb-46ed-9d71-621da33f1261 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:34.941018 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-80fce3cb-b5fb-46ed-9d71-621da33f1261 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:34.947844 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-80fce3cb-b5fb-46ed-9d71-621da33f1261 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:34.948296 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-80fce3cb-b5fb-46ed-9d71-621da33f1261 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:34.949083 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-80fce3cb-b5fb-46ed-9d71-621da33f1261 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:34.949548 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-80fce3cb-b5fb-46ed-9d71-621da33f1261 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:35.084457 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4c4ff073-f8ab-40f6-935d-0d8d1d48b27c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:35.085082 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4c4ff073-f8ab-40f6-935d-0d8d1d48b27c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:35.092779 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4c4ff073-f8ab-40f6-935d-0d8d1d48b27c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:35.093477 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4c4ff073-f8ab-40f6-935d-0d8d1d48b27c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:35.094471 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4c4ff073-f8ab-40f6-935d-0d8d1d48b27c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:35.095061 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4c4ff073-f8ab-40f6-935d-0d8d1d48b27c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:35.103951 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-80fce3cb-b5fb-46ed-9d71-621da33f1261 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:35.125973 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-80fce3cb-b5fb-46ed-9d71-621da33f1261 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:35.127604 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-80fce3cb-b5fb-46ed-9d71-621da33f1261 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:35.128907 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-80fce3cb-b5fb-46ed-9d71-621da33f1261 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.193796 Jun 16 16:20:35.130000 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 426/862] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:34 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:35.269525 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4c4ff073-f8ab-40f6-935d-0d8d1d48b27c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76571e533064b1ba007b5d1a025c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765cab7190f642e891d2e7236edc3a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:35.278751 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4c4ff073-f8ab-40f6-935d-0d8d1d48b27c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] 10.222.0.17 "GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2" status: 200 len: 1315 microversion: 2.1 time: 0.198083 Jun 16 16:20:35.279336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 437/863] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:35 2022] GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:20:36.148451 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-25ceb9ad-741f-4443-8d52-e751263e323a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:36.149073 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-25ceb9ad-741f-4443-8d52-e751263e323a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:36.156113 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-25ceb9ad-741f-4443-8d52-e751263e323a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:36.156562 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-25ceb9ad-741f-4443-8d52-e751263e323a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:36.157344 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-25ceb9ad-741f-4443-8d52-e751263e323a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:36.157785 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-25ceb9ad-741f-4443-8d52-e751263e323a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:36.297357 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-22f09dd4-9fc8-41a9-bf5c-55c8b2c2cd08 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:36.298755 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-22f09dd4-9fc8-41a9-bf5c-55c8b2c2cd08 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:36.313780 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-22f09dd4-9fc8-41a9-bf5c-55c8b2c2cd08 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:36.314615 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-22f09dd4-9fc8-41a9-bf5c-55c8b2c2cd08 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:36.315539 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-22f09dd4-9fc8-41a9-bf5c-55c8b2c2cd08 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:36.316012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-22f09dd4-9fc8-41a9-bf5c-55c8b2c2cd08 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:36.324644 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-25ceb9ad-741f-4443-8d52-e751263e323a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:36.341259 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-25ceb9ad-741f-4443-8d52-e751263e323a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:36.345191 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-25ceb9ad-741f-4443-8d52-e751263e323a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:36.347509 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-25ceb9ad-741f-4443-8d52-e751263e323a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.203151 Jun 16 16:20:36.348801 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 427/864] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:36 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:36.464652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-22f09dd4-9fc8-41a9-bf5c-55c8b2c2cd08 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76571e533064b1ba007b5d1a025c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765cab7190f642e891d2e7236edc3a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:36.472962 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-22f09dd4-9fc8-41a9-bf5c-55c8b2c2cd08 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] 10.222.0.17 "GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2" status: 200 len: 1315 microversion: 2.1 time: 0.181160 Jun 16 16:20:36.473546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 438/865] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:36 2022] GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:20:36.766091 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-4cdb4d54-3902-41c0-8ef4-86f78855e0ec req-43c68194-b1bc-447f-acdf-6e1c7f8686df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "199573a7-8f1c-4242-998f-cd6a0b8270b2", "name": "network-vif-plugged", "status": "completed", "tag": "31d9ee25-8948-4ebc-ac9c-b38c825d2c60"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:36.775624 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-4cdb4d54-3902-41c0-8ef4-86f78855e0ec req-43c68194-b1bc-447f-acdf-6e1c7f8686df service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:36.776439 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-4cdb4d54-3902-41c0-8ef4-86f78855e0ec req-43c68194-b1bc-447f-acdf-6e1c7f8686df service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:36.791912 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-4cdb4d54-3902-41c0-8ef4-86f78855e0ec req-43c68194-b1bc-447f-acdf-6e1c7f8686df service nova] Creating event network-vif-plugged:31d9ee25-8948-4ebc-ac9c-b38c825d2c60 for instance 199573a7-8f1c-4242-998f-cd6a0b8270b2 on hv-cinder-83716 Jun 16 16:20:36.798449 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-4cdb4d54-3902-41c0-8ef4-86f78855e0ec req-43c68194-b1bc-447f-acdf-6e1c7f8686df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036283 Jun 16 16:20:36.799317 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 428/866] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:37.367094 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d97ce839-c993-4257-8931-67a723bc0a87 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:37.368060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d97ce839-c993-4257-8931-67a723bc0a87 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:37.375782 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d97ce839-c993-4257-8931-67a723bc0a87 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:37.376320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d97ce839-c993-4257-8931-67a723bc0a87 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:37.377097 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d97ce839-c993-4257-8931-67a723bc0a87 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:37.377571 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d97ce839-c993-4257-8931-67a723bc0a87 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:37.494597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-58730ea4-994d-4d63-8ffa-ecfca7acd12f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:37.497068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-58730ea4-994d-4d63-8ffa-ecfca7acd12f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:37.503722 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58730ea4-994d-4d63-8ffa-ecfca7acd12f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:37.503905 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58730ea4-994d-4d63-8ffa-ecfca7acd12f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:37.504767 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58730ea4-994d-4d63-8ffa-ecfca7acd12f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:37.505270 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58730ea4-994d-4d63-8ffa-ecfca7acd12f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:37.534394 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d97ce839-c993-4257-8931-67a723bc0a87 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:37.544316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d97ce839-c993-4257-8931-67a723bc0a87 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:37.544603 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d97ce839-c993-4257-8931-67a723bc0a87 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:37.545748 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d97ce839-c993-4257-8931-67a723bc0a87 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.182474 Jun 16 16:20:37.546774 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 439/867] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:37 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:37.680263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-58730ea4-994d-4d63-8ffa-ecfca7acd12f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76571e533064b1ba007b5d1a025c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765cab7190f642e891d2e7236edc3a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:37.689251 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-58730ea4-994d-4d63-8ffa-ecfca7acd12f tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] 10.222.0.17 "GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2" status: 200 len: 1315 microversion: 2.1 time: 0.199676 Jun 16 16:20:37.689833 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 429/868] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:37 2022] GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:38.565397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-978fb455-2e43-4575-88fa-e6ed2909be77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:38.567014 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-978fb455-2e43-4575-88fa-e6ed2909be77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:38.574377 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-978fb455-2e43-4575-88fa-e6ed2909be77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:38.575600 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-978fb455-2e43-4575-88fa-e6ed2909be77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:38.576754 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-978fb455-2e43-4575-88fa-e6ed2909be77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:38.577622 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-978fb455-2e43-4575-88fa-e6ed2909be77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:38.707099 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3d2ccf7c-0836-44a0-aa8d-275462261d6e tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:38.707750 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3d2ccf7c-0836-44a0-aa8d-275462261d6e tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:38.720064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d2ccf7c-0836-44a0-aa8d-275462261d6e tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:38.720820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d2ccf7c-0836-44a0-aa8d-275462261d6e tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:38.722071 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d2ccf7c-0836-44a0-aa8d-275462261d6e tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:38.722841 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3d2ccf7c-0836-44a0-aa8d-275462261d6e tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:38.747705 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-978fb455-2e43-4575-88fa-e6ed2909be77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:38.761758 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-978fb455-2e43-4575-88fa-e6ed2909be77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:38.764523 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-978fb455-2e43-4575-88fa-e6ed2909be77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:38.766612 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-978fb455-2e43-4575-88fa-e6ed2909be77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.205600 Jun 16 16:20:38.767958 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 440/869] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:38 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:38.902660 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3d2ccf7c-0836-44a0-aa8d-275462261d6e tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76571e533064b1ba007b5d1a025c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765cab7190f642e891d2e7236edc3a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:38.911985 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3d2ccf7c-0836-44a0-aa8d-275462261d6e tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] 10.222.0.17 "GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2" status: 200 len: 1464 microversion: 2.1 time: 0.209114 Jun 16 16:20:38.912562 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 430/870] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:38 2022] GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2 => generated 1464 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:38.961150 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-de37f421-2a18-4bc8-af2e-6ab2a81f2bd2 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:38.961913 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-de37f421-2a18-4bc8-af2e-6ab2a81f2bd2 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:38.964358 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:38.965323 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=6 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:38.973998 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-de37f421-2a18-4bc8-af2e-6ab2a81f2bd2 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:38.974785 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-de37f421-2a18-4bc8-af2e-6ab2a81f2bd2 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:38.975958 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-de37f421-2a18-4bc8-af2e-6ab2a81f2bd2 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:38.976464 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-de37f421-2a18-4bc8-af2e-6ab2a81f2bd2 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:39.018474 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-de37f421-2a18-4bc8-af2e-6ab2a81f2bd2 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] Going to try to terminate instance {{(pid=117756) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:20:39.122035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-de37f421-2a18-4bc8-af2e-6ab2a81f2bd2 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] 10.222.0.17 "DELETE /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2" status: 204 len: 0 microversion: 2.1 time: 0.171637 Jun 16 16:20:39.131210 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 441/871] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:20:38 2022] DELETE /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:20:39.137471 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-abd08130-e756-40a4-a2dc-7e56acbee049 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:39.138344 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-abd08130-e756-40a4-a2dc-7e56acbee049 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:39.143049 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=2 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:39.147617 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-abd08130-e756-40a4-a2dc-7e56acbee049 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:39.148217 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-abd08130-e756-40a4-a2dc-7e56acbee049 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:39.149080 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-abd08130-e756-40a4-a2dc-7e56acbee049 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:39.149522 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-abd08130-e756-40a4-a2dc-7e56acbee049 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:39.317713 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-abd08130-e756-40a4-a2dc-7e56acbee049 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76571e533064b1ba007b5d1a025c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765cab7190f642e891d2e7236edc3a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:39.329024 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-abd08130-e756-40a4-a2dc-7e56acbee049 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] 10.222.0.17 "GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2" status: 200 len: 1470 microversion: 2.1 time: 0.195310 Jun 16 16:20:39.329472 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 431/872] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:39 2022] GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2 => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:39.797347 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-79e71207-f854-4fd3-b05e-513f3b4767cf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:39.798428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-79e71207-f854-4fd3-b05e-513f3b4767cf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:39.806266 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-79e71207-f854-4fd3-b05e-513f3b4767cf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:39.806706 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-79e71207-f854-4fd3-b05e-513f3b4767cf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:39.807488 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-79e71207-f854-4fd3-b05e-513f3b4767cf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:39.808267 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-79e71207-f854-4fd3-b05e-513f3b4767cf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:39.985476 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-79e71207-f854-4fd3-b05e-513f3b4767cf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:39.994234 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-79e71207-f854-4fd3-b05e-513f3b4767cf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:39.995755 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-79e71207-f854-4fd3-b05e-513f3b4767cf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:39.997031 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-79e71207-f854-4fd3-b05e-513f3b4767cf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.205039 Jun 16 16:20:39.997652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 442/873] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:39 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:40.352042 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-435591c8-c146-4c67-afab-a9c63dec3ad6 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:40.353233 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-435591c8-c146-4c67-afab-a9c63dec3ad6 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:40.364285 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-435591c8-c146-4c67-afab-a9c63dec3ad6 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:40.364866 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-435591c8-c146-4c67-afab-a9c63dec3ad6 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:40.365846 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-435591c8-c146-4c67-afab-a9c63dec3ad6 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:40.366408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-435591c8-c146-4c67-afab-a9c63dec3ad6 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:40.541001 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-435591c8-c146-4c67-afab-a9c63dec3ad6 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76571e533064b1ba007b5d1a025c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765cab7190f642e891d2e7236edc3a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:40.550353 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-435591c8-c146-4c67-afab-a9c63dec3ad6 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] 10.222.0.17 "GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2" status: 200 len: 1470 microversion: 2.1 time: 0.204867 Jun 16 16:20:40.550956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 432/874] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:40 2022] GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2 => generated 1470 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:41.017908 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-78f772c9-3d42-45f2-bd88-a86e5c667c77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:41.018573 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-78f772c9-3d42-45f2-bd88-a86e5c667c77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:41.025490 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-78f772c9-3d42-45f2-bd88-a86e5c667c77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:41.026001 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-78f772c9-3d42-45f2-bd88-a86e5c667c77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:41.026795 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-78f772c9-3d42-45f2-bd88-a86e5c667c77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:41.027266 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-78f772c9-3d42-45f2-bd88-a86e5c667c77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:41.266075 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-78f772c9-3d42-45f2-bd88-a86e5c667c77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:41.274774 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-78f772c9-3d42-45f2-bd88-a86e5c667c77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:41.276549 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-78f772c9-3d42-45f2-bd88-a86e5c667c77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:41.277858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-78f772c9-3d42-45f2-bd88-a86e5c667c77 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.265877 Jun 16 16:20:41.278531 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 443/875] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:41 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:41.571256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b2c2e2c6-7903-46a4-8076-b94065078157 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:41.572127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b2c2e2c6-7903-46a4-8076-b94065078157 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:41.582672 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b2c2e2c6-7903-46a4-8076-b94065078157 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:41.583266 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b2c2e2c6-7903-46a4-8076-b94065078157 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:41.584468 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b2c2e2c6-7903-46a4-8076-b94065078157 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:41.585324 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b2c2e2c6-7903-46a4-8076-b94065078157 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:41.721262 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b2c2e2c6-7903-46a4-8076-b94065078157 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76571e533064b1ba007b5d1a025c3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765cab7190f642e891d2e7236edc3a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:41.727948 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-f5bb09bb-96c0-4ffd-b7ba-ff81331f0497 req-ccd253e6-a23b-44b6-bb84-3b2bc9650438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "199573a7-8f1c-4242-998f-cd6a0b8270b2", "name": "network-vif-deleted", "tag": "31d9ee25-8948-4ebc-ac9c-b38c825d2c60"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:41.732215 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b2c2e2c6-7903-46a4-8076-b94065078157 tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] 10.222.0.17 "GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2" status: 200 len: 1428 microversion: 2.1 time: 0.165241 Jun 16 16:20:41.733745 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 433/876] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:41 2022] GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2 => generated 1428 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:41.741995 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-f5bb09bb-96c0-4ffd-b7ba-ff81331f0497 req-ccd253e6-a23b-44b6-bb84-3b2bc9650438 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:41.742917 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-f5bb09bb-96c0-4ffd-b7ba-ff81331f0497 req-ccd253e6-a23b-44b6-bb84-3b2bc9650438 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:41.786313 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-f5bb09bb-96c0-4ffd-b7ba-ff81331f0497 req-ccd253e6-a23b-44b6-bb84-3b2bc9650438 service nova] Creating event network-vif-deleted:31d9ee25-8948-4ebc-ac9c-b38c825d2c60 for instance 199573a7-8f1c-4242-998f-cd6a0b8270b2 on hv-cinder-83716 Jun 16 16:20:41.793642 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-f5bb09bb-96c0-4ffd-b7ba-ff81331f0497 req-ccd253e6-a23b-44b6-bb84-3b2bc9650438 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070286 Jun 16 16:20:41.794430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 444/877] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:20:42.297229 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f60c8b4e-0f42-463b-818a-a200381e9962 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:42.297850 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f60c8b4e-0f42-463b-818a-a200381e9962 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:42.307005 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f60c8b4e-0f42-463b-818a-a200381e9962 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:42.307621 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f60c8b4e-0f42-463b-818a-a200381e9962 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:42.308407 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f60c8b4e-0f42-463b-818a-a200381e9962 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:42.309037 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f60c8b4e-0f42-463b-818a-a200381e9962 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:42.636845 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f60c8b4e-0f42-463b-818a-a200381e9962 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:42.653252 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f60c8b4e-0f42-463b-818a-a200381e9962 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:42.655577 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f60c8b4e-0f42-463b-818a-a200381e9962 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:42.657037 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f60c8b4e-0f42-463b-818a-a200381e9962 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.363672 Jun 16 16:20:42.657428 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 434/878] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:42 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:20:42.750111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4dda5b59-31dc-476b-b808-815b4c914a5c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:42.750989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4dda5b59-31dc-476b-b808-815b4c914a5c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] [instance: 199573a7-8f1c-4242-998f-cd6a0b8270b2] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:42.757737 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4dda5b59-31dc-476b-b808-815b4c914a5c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:42.758225 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4dda5b59-31dc-476b-b808-815b4c914a5c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:42.759271 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4dda5b59-31dc-476b-b808-815b4c914a5c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:42.759700 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4dda5b59-31dc-476b-b808-815b4c914a5c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:42.773843 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-4dda5b59-31dc-476b-b808-815b4c914a5c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] HTTP exception thrown: Instance 199573a7-8f1c-4242-998f-cd6a0b8270b2 could not be found. Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4dda5b59-31dc-476b-b808-815b4c914a5c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Request method failure captured: Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2 HTTP/1.1 Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1hK1K_9JKiOYYL0AiYvQH9tFCmXw0jLUexKM2MRrQ5wl1gTzGkQlHtQr7C4FyBN0tsz-mYQ4Xhq-8MX8lFLwlryE9BSTpg802aYeagIYhv_dmCTARVDvA988xsbslkdfYMQ1z2fx9hP2dAClH6zO4oAZ3dHlL3Yy93haOxge37Kki4 Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 765cab7190f642e891d2e7236edc3a8a Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-VolumesNegativeTest-36741680 Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:20:42.775535 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:20:42.777054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_765cab7190f642e891d2e7236edc3a8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/765cab7190f642e891d2e7236edc3a8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/765cab7190f642e891d2e7236edc3a8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/765cab7190f642e891d2e7236edc3a8a"}]}] Jun 16 16:20:42.777054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-VolumesNegativeTest-36741680 Jun 16 16:20:42.777054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 765cab7190f642e891d2e7236edc3a8a Jun 16 16:20:42.777054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-VolumesNegativeTest-36741680 Jun 16 16:20:42.777054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-VolumesNegativeTest-36741680-project Jun 16 16:20:42.777054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:20:42.777054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:20:42.777054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: a76571e533064b1ba007b5d1a025c3cf Jun 16 16:20:42.777054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-VolumesNegativeTest-36741680-project Jun 16 16:20:42.777054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:20:42.777054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance 199573a7-8f1c-4242-998f-cd6a0b8270b2 could not be found. Jun 16 16:20:42.777054 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': '199573a7-8f1c-4242-998f-cd6a0b8270b2'} Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 199573a7-8f1c-4242-998f-cd6a0b8270b2 could not be found. Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:20:42.778027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 199573a7-8f1c-4242-998f-cd6a0b8270b2 could not be found. Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 199573a7-8f1c-4242-998f-cd6a0b8270b2 could not be found. Jun 16 16:20:42.780546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:20:42.782120 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4dda5b59-31dc-476b-b808-815b4c914a5c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] Returning 404 to user: Instance 199573a7-8f1c-4242-998f-cd6a0b8270b2 could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:20:42.782120 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4dda5b59-31dc-476b-b808-815b4c914a5c tempest-VolumesNegativeTest-36741680 tempest-VolumesNegativeTest-36741680-project] 10.222.0.17 "GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2" status: 404 len: 111 microversion: 2.1 time: 0.031421 Jun 16 16:20:42.782120 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 445/879] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:42 2022] GET /compute/v2.1/servers/199573a7-8f1c-4242-998f-cd6a0b8270b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:20:43.675983 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-52107194-8e69-47de-8017-7634d9206a49 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:43.676672 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-52107194-8e69-47de-8017-7634d9206a49 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:43.685849 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-52107194-8e69-47de-8017-7634d9206a49 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:43.686389 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-52107194-8e69-47de-8017-7634d9206a49 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:43.688114 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-52107194-8e69-47de-8017-7634d9206a49 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:43.688624 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-52107194-8e69-47de-8017-7634d9206a49 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:43.865573 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-52107194-8e69-47de-8017-7634d9206a49 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:43.874284 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-52107194-8e69-47de-8017-7634d9206a49 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:43.876177 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-52107194-8e69-47de-8017-7634d9206a49 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:43.877330 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-52107194-8e69-47de-8017-7634d9206a49 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.206185 Jun 16 16:20:43.877959 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 435/880] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:43 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:20:44.896788 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e390f36b-caa9-4212-83dd-b4f157b5e4a2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:44.897409 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e390f36b-caa9-4212-83dd-b4f157b5e4a2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:44.904018 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e390f36b-caa9-4212-83dd-b4f157b5e4a2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:44.905232 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e390f36b-caa9-4212-83dd-b4f157b5e4a2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:44.905873 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e390f36b-caa9-4212-83dd-b4f157b5e4a2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:44.907840 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e390f36b-caa9-4212-83dd-b4f157b5e4a2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:44.912556 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:45.072458 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e390f36b-caa9-4212-83dd-b4f157b5e4a2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:45.086651 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e390f36b-caa9-4212-83dd-b4f157b5e4a2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:45.087962 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e390f36b-caa9-4212-83dd-b4f157b5e4a2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:45.089228 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e390f36b-caa9-4212-83dd-b4f157b5e4a2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.196464 Jun 16 16:20:45.090087 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 446/881] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:44 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:46.109419 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-102494eb-69d6-4357-9873-6e7f4cdd299c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:46.110346 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-102494eb-69d6-4357-9873-6e7f4cdd299c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:46.117167 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-102494eb-69d6-4357-9873-6e7f4cdd299c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:46.118187 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-102494eb-69d6-4357-9873-6e7f4cdd299c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:46.119296 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-102494eb-69d6-4357-9873-6e7f4cdd299c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:46.119956 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-102494eb-69d6-4357-9873-6e7f4cdd299c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:46.282723 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-102494eb-69d6-4357-9873-6e7f4cdd299c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:46.291499 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-102494eb-69d6-4357-9873-6e7f4cdd299c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:46.292981 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-102494eb-69d6-4357-9873-6e7f4cdd299c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:46.294176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-102494eb-69d6-4357-9873-6e7f4cdd299c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.189458 Jun 16 16:20:46.294728 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 436/882] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:46 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:47.313543 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e042e6f7-fc57-402d-b7f7-7bd8f783dd45 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:47.314191 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e042e6f7-fc57-402d-b7f7-7bd8f783dd45 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:47.321711 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e042e6f7-fc57-402d-b7f7-7bd8f783dd45 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:47.322222 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e042e6f7-fc57-402d-b7f7-7bd8f783dd45 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:47.323180 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e042e6f7-fc57-402d-b7f7-7bd8f783dd45 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:47.323999 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e042e6f7-fc57-402d-b7f7-7bd8f783dd45 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:47.608928 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e042e6f7-fc57-402d-b7f7-7bd8f783dd45 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:47.620366 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e042e6f7-fc57-402d-b7f7-7bd8f783dd45 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:47.623837 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e042e6f7-fc57-402d-b7f7-7bd8f783dd45 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:47.625914 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e042e6f7-fc57-402d-b7f7-7bd8f783dd45 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.316278 Jun 16 16:20:47.627149 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 447/883] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:47 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:48.645938 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2a720214-3e09-423f-a19a-288bb5e403be tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:48.646652 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2a720214-3e09-423f-a19a-288bb5e403be tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:48.655109 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2a720214-3e09-423f-a19a-288bb5e403be tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:48.655964 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2a720214-3e09-423f-a19a-288bb5e403be tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:48.657784 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2a720214-3e09-423f-a19a-288bb5e403be tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:48.658710 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2a720214-3e09-423f-a19a-288bb5e403be tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:48.832175 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2a720214-3e09-423f-a19a-288bb5e403be tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:48.841486 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2a720214-3e09-423f-a19a-288bb5e403be tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:48.843548 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2a720214-3e09-423f-a19a-288bb5e403be tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:48.845332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2a720214-3e09-423f-a19a-288bb5e403be tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1743 microversion: 2.20 time: 0.203741 Jun 16 16:20:48.846285 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 437/884] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:48 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1743 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:49.866485 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b0497e96-30ce-40f1-bf92-72b3579cda0e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:49.867105 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b0497e96-30ce-40f1-bf92-72b3579cda0e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:49.875388 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b0497e96-30ce-40f1-bf92-72b3579cda0e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:49.876136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b0497e96-30ce-40f1-bf92-72b3579cda0e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:49.877209 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b0497e96-30ce-40f1-bf92-72b3579cda0e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:49.878030 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b0497e96-30ce-40f1-bf92-72b3579cda0e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:50.098987 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b0497e96-30ce-40f1-bf92-72b3579cda0e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:50.110246 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b0497e96-30ce-40f1-bf92-72b3579cda0e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:50.114470 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b0497e96-30ce-40f1-bf92-72b3579cda0e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:50.116104 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b0497e96-30ce-40f1-bf92-72b3579cda0e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1743 microversion: 2.20 time: 0.254624 Jun 16 16:20:50.128948 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 448/885] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:49 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1743 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:51.135516 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-373db51e-88d5-499c-9b1a-0fc0aabd5ccf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:51.136113 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-373db51e-88d5-499c-9b1a-0fc0aabd5ccf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:51.149198 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-373db51e-88d5-499c-9b1a-0fc0aabd5ccf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:51.149652 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-373db51e-88d5-499c-9b1a-0fc0aabd5ccf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:51.151390 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-373db51e-88d5-499c-9b1a-0fc0aabd5ccf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:51.157508 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-373db51e-88d5-499c-9b1a-0fc0aabd5ccf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:51.457513 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-373db51e-88d5-499c-9b1a-0fc0aabd5ccf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:51.477724 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-373db51e-88d5-499c-9b1a-0fc0aabd5ccf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:51.488452 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-373db51e-88d5-499c-9b1a-0fc0aabd5ccf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:51.489974 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-373db51e-88d5-499c-9b1a-0fc0aabd5ccf tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1738 microversion: 2.20 time: 0.358632 Jun 16 16:20:51.490764 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 438/886] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:51 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1738 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:52.511383 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c6e5c96f-0bb8-476f-8b38-e6b61a7a675f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:52.512007 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c6e5c96f-0bb8-476f-8b38-e6b61a7a675f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:52.532310 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c6e5c96f-0bb8-476f-8b38-e6b61a7a675f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:52.532767 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c6e5c96f-0bb8-476f-8b38-e6b61a7a675f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:52.536894 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c6e5c96f-0bb8-476f-8b38-e6b61a7a675f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:52.537518 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c6e5c96f-0bb8-476f-8b38-e6b61a7a675f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:52.747149 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c6e5c96f-0bb8-476f-8b38-e6b61a7a675f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:52.780381 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c6e5c96f-0bb8-476f-8b38-e6b61a7a675f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:52.783088 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c6e5c96f-0bb8-476f-8b38-e6b61a7a675f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:52.786545 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c6e5c96f-0bb8-476f-8b38-e6b61a7a675f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1738 microversion: 2.20 time: 0.279030 Jun 16 16:20:52.790136 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 449/887] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:52 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1738 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:53.583061 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-2cdbdb60-a200-4528-9291-5b2991e0d4de req-33214ca6-657d-45c6-9c58-c46dd04a2231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4412fc83-e558-4531-8295-ee5a4f1ba983", "name": "network-vif-plugged", "status": "completed", "tag": "1f148a28-fe89-4254-bdba-5773896f6c82"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:53.601811 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-2cdbdb60-a200-4528-9291-5b2991e0d4de req-33214ca6-657d-45c6-9c58-c46dd04a2231 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:53.602531 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-2cdbdb60-a200-4528-9291-5b2991e0d4de req-33214ca6-657d-45c6-9c58-c46dd04a2231 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:53.631031 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-2cdbdb60-a200-4528-9291-5b2991e0d4de req-33214ca6-657d-45c6-9c58-c46dd04a2231 service nova] Creating event network-vif-plugged:1f148a28-fe89-4254-bdba-5773896f6c82 for instance 4412fc83-e558-4531-8295-ee5a4f1ba983 on hv-cinder-83716 Jun 16 16:20:53.646453 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-2cdbdb60-a200-4528-9291-5b2991e0d4de req-33214ca6-657d-45c6-9c58-c46dd04a2231 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067394 Jun 16 16:20:53.650682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 439/888] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:53.815674 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-abf7a33c-5696-472d-9c25-dfac1bdb5436 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:53.817065 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-abf7a33c-5696-472d-9c25-dfac1bdb5436 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:53.824474 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-abf7a33c-5696-472d-9c25-dfac1bdb5436 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:53.825387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-abf7a33c-5696-472d-9c25-dfac1bdb5436 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:53.827032 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-abf7a33c-5696-472d-9c25-dfac1bdb5436 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:53.827643 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-abf7a33c-5696-472d-9c25-dfac1bdb5436 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:54.557261 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-abf7a33c-5696-472d-9c25-dfac1bdb5436 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:54.575135 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-abf7a33c-5696-472d-9c25-dfac1bdb5436 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:54.579552 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-abf7a33c-5696-472d-9c25-dfac1bdb5436 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:54.586149 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-abf7a33c-5696-472d-9c25-dfac1bdb5436 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1738 microversion: 2.20 time: 0.771617 Jun 16 16:20:54.587083 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 450/889] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:53 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1738 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:55.611723 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f006d14c-4507-4c9c-8354-f4c49670838b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:55.613166 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f006d14c-4507-4c9c-8354-f4c49670838b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:55.619168 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=41 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:55.622435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f006d14c-4507-4c9c-8354-f4c49670838b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:55.635031 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f006d14c-4507-4c9c-8354-f4c49670838b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:55.639437 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f006d14c-4507-4c9c-8354-f4c49670838b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:55.640246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f006d14c-4507-4c9c-8354-f4c49670838b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:55.645600 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=97 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:55.853558 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f006d14c-4507-4c9c-8354-f4c49670838b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:55.894450 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f006d14c-4507-4c9c-8354-f4c49670838b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:55.896331 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f006d14c-4507-4c9c-8354-f4c49670838b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:55.898822 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f006d14c-4507-4c9c-8354-f4c49670838b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1738 microversion: 2.20 time: 0.292046 Jun 16 16:20:55.899564 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 440/890] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:55 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:56.926609 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-75c03a8c-28cd-4af8-afe9-59854d269313 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:56.927992 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-75c03a8c-28cd-4af8-afe9-59854d269313 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:56.940126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:56.942793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-75c03a8c-28cd-4af8-afe9-59854d269313 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:56.943599 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-75c03a8c-28cd-4af8-afe9-59854d269313 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:56.944724 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-75c03a8c-28cd-4af8-afe9-59854d269313 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:56.945502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-75c03a8c-28cd-4af8-afe9-59854d269313 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:57.504720 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-75c03a8c-28cd-4af8-afe9-59854d269313 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:57.528259 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-75c03a8c-28cd-4af8-afe9-59854d269313 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:57.532789 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-75c03a8c-28cd-4af8-afe9-59854d269313 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:57.535406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-75c03a8c-28cd-4af8-afe9-59854d269313 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1738 microversion: 2.20 time: 0.613760 Jun 16 16:20:57.537726 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 451/891] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:56 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1738 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:58.566588 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e26de223-1273-4414-853d-703a24e03bb0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:58.569136 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e26de223-1273-4414-853d-703a24e03bb0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:58.595423 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e26de223-1273-4414-853d-703a24e03bb0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:58.596478 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e26de223-1273-4414-853d-703a24e03bb0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:58.597869 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e26de223-1273-4414-853d-703a24e03bb0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:58.598675 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e26de223-1273-4414-853d-703a24e03bb0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:59.053364 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e26de223-1273-4414-853d-703a24e03bb0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:59.080001 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e26de223-1273-4414-853d-703a24e03bb0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:59.089476 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e26de223-1273-4414-853d-703a24e03bb0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:59.097998 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e26de223-1273-4414-853d-703a24e03bb0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1738 microversion: 2.20 time: 0.535663 Jun 16 16:20:59.102857 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 441/892] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:58 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1738 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:00.121675 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-121e0c92-4f5b-4e1f-85af-ebba83d899c9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:00.123878 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-121e0c92-4f5b-4e1f-85af-ebba83d899c9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:00.139919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-121e0c92-4f5b-4e1f-85af-ebba83d899c9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:00.140281 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-121e0c92-4f5b-4e1f-85af-ebba83d899c9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:00.142089 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-121e0c92-4f5b-4e1f-85af-ebba83d899c9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:00.143227 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-121e0c92-4f5b-4e1f-85af-ebba83d899c9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:00.596707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-121e0c92-4f5b-4e1f-85af-ebba83d899c9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:00.607486 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-121e0c92-4f5b-4e1f-85af-ebba83d899c9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:00.609802 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-121e0c92-4f5b-4e1f-85af-ebba83d899c9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:00.612146 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-121e0c92-4f5b-4e1f-85af-ebba83d899c9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1738 microversion: 2.20 time: 0.494525 Jun 16 16:21:00.625719 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 452/893] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:00 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1738 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:01.634697 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-553c4f4c-663e-4b7c-9609-2b4c57ce26d1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:01.635591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-553c4f4c-663e-4b7c-9609-2b4c57ce26d1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:01.671166 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-553c4f4c-663e-4b7c-9609-2b4c57ce26d1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:01.671634 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-553c4f4c-663e-4b7c-9609-2b4c57ce26d1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:01.677223 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-553c4f4c-663e-4b7c-9609-2b4c57ce26d1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:01.677721 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-553c4f4c-663e-4b7c-9609-2b4c57ce26d1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:02.007792 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-553c4f4c-663e-4b7c-9609-2b4c57ce26d1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:02.021020 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-553c4f4c-663e-4b7c-9609-2b4c57ce26d1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:02.027263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-553c4f4c-663e-4b7c-9609-2b4c57ce26d1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:02.028502 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-553c4f4c-663e-4b7c-9609-2b4c57ce26d1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1738 microversion: 2.20 time: 0.400134 Jun 16 16:21:02.033775 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 442/894] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:01 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1738 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:03.051143 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-417aa099-c66e-4016-a871-35a3b52339eb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:03.052435 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-417aa099-c66e-4016-a871-35a3b52339eb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:03.070949 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-417aa099-c66e-4016-a871-35a3b52339eb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:03.071682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-417aa099-c66e-4016-a871-35a3b52339eb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:03.075608 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-417aa099-c66e-4016-a871-35a3b52339eb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:03.076223 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-417aa099-c66e-4016-a871-35a3b52339eb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:03.400104 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-417aa099-c66e-4016-a871-35a3b52339eb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:03.409407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-417aa099-c66e-4016-a871-35a3b52339eb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:03.414679 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-417aa099-c66e-4016-a871-35a3b52339eb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:03.415911 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-417aa099-c66e-4016-a871-35a3b52339eb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1738 microversion: 2.20 time: 0.371144 Jun 16 16:21:03.432803 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 453/895] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:03 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1738 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:21:04.440968 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b0dd3fb8-2461-4530-9cce-21fcdf269386 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:04.441815 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b0dd3fb8-2461-4530-9cce-21fcdf269386 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:04.455517 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b0dd3fb8-2461-4530-9cce-21fcdf269386 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:04.456787 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b0dd3fb8-2461-4530-9cce-21fcdf269386 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:04.457852 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b0dd3fb8-2461-4530-9cce-21fcdf269386 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:04.458547 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b0dd3fb8-2461-4530-9cce-21fcdf269386 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:04.743820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b0dd3fb8-2461-4530-9cce-21fcdf269386 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:04.766261 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b0dd3fb8-2461-4530-9cce-21fcdf269386 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:04.770891 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b0dd3fb8-2461-4530-9cce-21fcdf269386 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:04.772169 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b0dd3fb8-2461-4530-9cce-21fcdf269386 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1738 microversion: 2.20 time: 0.338127 Jun 16 16:21:04.772748 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 443/896] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:04 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1738 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:05.018472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-9d1f5024-3656-4e98-8540-ea2a69ae9809 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Action: 'create', calling method: .version_select at 0x7f38bb6ca5e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-229178973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLK43VqwN2yx/wSrzOJZLuOJm78b4ofUEmzSCuw/RVjOttRHLqbTVMEcOxSDrI0SGmZPvYK/5M4Sh+b0PuoBJwUFgliew89cLsjsv0Hvh25PWX/rKcnTe6D0Y6swir3CYg=="}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:05.065728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-9d1f5024-3656-4e98-8540-ea2a69ae9809 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Getting quotas for project bd7ec755d96f4dee964a003d6c269c4e. Resources: {'key_pairs'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:21:05.071103 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-9d1f5024-3656-4e98-8540-ea2a69ae9809 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Getting quotas for user 080c7129a52e49c698cb2dc4afe14de7 and project bd7ec755d96f4dee964a003d6c269c4e. Resources: {'key_pairs'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:21:05.134463 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-9d1f5024-3656-4e98-8540-ea2a69ae9809 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.492446 Jun 16 16:21:05.135715 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 454/897] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 16:21:04 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:05.796290 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bec1cdab-abdb-48fb-a9f8-d5ff4a858650 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:05.797058 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bec1cdab-abdb-48fb-a9f8-d5ff4a858650 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:05.810206 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bec1cdab-abdb-48fb-a9f8-d5ff4a858650 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:05.812345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bec1cdab-abdb-48fb-a9f8-d5ff4a858650 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:05.815212 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bec1cdab-abdb-48fb-a9f8-d5ff4a858650 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:05.815892 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bec1cdab-abdb-48fb-a9f8-d5ff4a858650 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:06.286345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bec1cdab-abdb-48fb-a9f8-d5ff4a858650 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:06.320546 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bec1cdab-abdb-48fb-a9f8-d5ff4a858650 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:06.331792 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bec1cdab-abdb-48fb-a9f8-d5ff4a858650 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:06.335159 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bec1cdab-abdb-48fb-a9f8-d5ff4a858650 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1738 microversion: 2.20 time: 0.547307 Jun 16 16:21:06.335749 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 444/898] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:05 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1738 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:07.359619 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6a9ac174-8543-4930-bba4-72b6a6178cfb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:07.360240 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6a9ac174-8543-4930-bba4-72b6a6178cfb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:07.374638 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6a9ac174-8543-4930-bba4-72b6a6178cfb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:07.375097 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6a9ac174-8543-4930-bba4-72b6a6178cfb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:07.377866 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6a9ac174-8543-4930-bba4-72b6a6178cfb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:07.381125 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6a9ac174-8543-4930-bba4-72b6a6178cfb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:07.696855 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6a9ac174-8543-4930-bba4-72b6a6178cfb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:07.713202 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6a9ac174-8543-4930-bba4-72b6a6178cfb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:07.716252 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6a9ac174-8543-4930-bba4-72b6a6178cfb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:07.720692 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6a9ac174-8543-4930-bba4-72b6a6178cfb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1738 microversion: 2.20 time: 0.366718 Jun 16 16:21:07.723272 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 455/899] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:07 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1738 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:08.745627 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d2c90d59-9fcb-45b3-9026-6925f6e45dac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:08.746377 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d2c90d59-9fcb-45b3-9026-6925f6e45dac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:08.760719 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d2c90d59-9fcb-45b3-9026-6925f6e45dac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:08.761315 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d2c90d59-9fcb-45b3-9026-6925f6e45dac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:08.762238 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d2c90d59-9fcb-45b3-9026-6925f6e45dac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:08.764114 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d2c90d59-9fcb-45b3-9026-6925f6e45dac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:09.312732 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d2c90d59-9fcb-45b3-9026-6925f6e45dac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:09.325157 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d2c90d59-9fcb-45b3-9026-6925f6e45dac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:09.331913 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d2c90d59-9fcb-45b3-9026-6925f6e45dac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:09.337194 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d2c90d59-9fcb-45b3-9026-6925f6e45dac tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1738 microversion: 2.20 time: 0.597106 Jun 16 16:21:09.338874 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 445/900] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:08 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1738 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:10.358757 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e69b154b-745c-439c-b5af-43f7144597d5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:10.359621 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e69b154b-745c-439c-b5af-43f7144597d5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:10.391719 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e69b154b-745c-439c-b5af-43f7144597d5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:10.393157 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e69b154b-745c-439c-b5af-43f7144597d5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:10.397153 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e69b154b-745c-439c-b5af-43f7144597d5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:10.400451 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e69b154b-745c-439c-b5af-43f7144597d5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:10.753343 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e69b154b-745c-439c-b5af-43f7144597d5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:10.772235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e69b154b-745c-439c-b5af-43f7144597d5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:10.775743 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e69b154b-745c-439c-b5af-43f7144597d5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:10.798445 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e69b154b-745c-439c-b5af-43f7144597d5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1738 microversion: 2.20 time: 0.439034 Jun 16 16:21:10.813481 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 456/901] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:10 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1738 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:11.820318 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-41ca9f8e-3429-4afc-88b1-62f5027d2a2b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:11.821281 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-41ca9f8e-3429-4afc-88b1-62f5027d2a2b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:11.831666 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-41ca9f8e-3429-4afc-88b1-62f5027d2a2b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:11.832601 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-41ca9f8e-3429-4afc-88b1-62f5027d2a2b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:11.833559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-41ca9f8e-3429-4afc-88b1-62f5027d2a2b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:11.834518 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-41ca9f8e-3429-4afc-88b1-62f5027d2a2b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:12.061109 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-41ca9f8e-3429-4afc-88b1-62f5027d2a2b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:12.086014 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-41ca9f8e-3429-4afc-88b1-62f5027d2a2b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:12.092493 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-41ca9f8e-3429-4afc-88b1-62f5027d2a2b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:12.094656 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-41ca9f8e-3429-4afc-88b1-62f5027d2a2b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1738 microversion: 2.20 time: 0.279238 Jun 16 16:21:12.100407 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 446/902] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:11 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1738 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:21:13.115641 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-716779e7-d86e-4bc5-a7bc-6819d8341a29 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:13.116270 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-716779e7-d86e-4bc5-a7bc-6819d8341a29 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:13.129685 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-716779e7-d86e-4bc5-a7bc-6819d8341a29 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:13.130180 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-716779e7-d86e-4bc5-a7bc-6819d8341a29 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:13.130998 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-716779e7-d86e-4bc5-a7bc-6819d8341a29 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:13.131430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-716779e7-d86e-4bc5-a7bc-6819d8341a29 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:13.492033 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-716779e7-d86e-4bc5-a7bc-6819d8341a29 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:13.537180 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-716779e7-d86e-4bc5-a7bc-6819d8341a29 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:13.544466 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-716779e7-d86e-4bc5-a7bc-6819d8341a29 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:13.546925 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-716779e7-d86e-4bc5-a7bc-6819d8341a29 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1720 microversion: 2.20 time: 0.436074 Jun 16 16:21:13.560858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 457/903] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:13 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1720 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:14.571205 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-921c51d3-e3c7-4665-8850-e35e840d884a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:14.572546 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-921c51d3-e3c7-4665-8850-e35e840d884a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:14.582332 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-921c51d3-e3c7-4665-8850-e35e840d884a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:14.587010 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-921c51d3-e3c7-4665-8850-e35e840d884a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:14.589154 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-921c51d3-e3c7-4665-8850-e35e840d884a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:14.589889 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-921c51d3-e3c7-4665-8850-e35e840d884a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:14.830869 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-921c51d3-e3c7-4665-8850-e35e840d884a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:14.846242 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-921c51d3-e3c7-4665-8850-e35e840d884a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:14.853230 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-921c51d3-e3c7-4665-8850-e35e840d884a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:14.855012 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-921c51d3-e3c7-4665-8850-e35e840d884a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1720 microversion: 2.20 time: 0.291427 Jun 16 16:21:14.856405 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 447/904] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:14 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1720 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:15.789699 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-5a143319-0b8c-4bbf-a168-ebc74398fbad req-e94384cf-d19a-48e8-8e14-a9ce41059b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4412fc83-e558-4531-8295-ee5a4f1ba983", "name": "network-vif-unplugged", "status": "completed", "tag": "1f148a28-fe89-4254-bdba-5773896f6c82"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:15.798476 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=4 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:15.816708 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-5a143319-0b8c-4bbf-a168-ebc74398fbad req-e94384cf-d19a-48e8-8e14-a9ce41059b85 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:15.817314 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-5a143319-0b8c-4bbf-a168-ebc74398fbad req-e94384cf-d19a-48e8-8e14-a9ce41059b85 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:15.822813 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=65 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:15.833061 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-5a143319-0b8c-4bbf-a168-ebc74398fbad req-e94384cf-d19a-48e8-8e14-a9ce41059b85 service nova] Creating event network-vif-unplugged:1f148a28-fe89-4254-bdba-5773896f6c82 for instance 4412fc83-e558-4531-8295-ee5a4f1ba983 on hv-cinder-83716 Jun 16 16:21:15.840324 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-5a143319-0b8c-4bbf-a168-ebc74398fbad req-e94384cf-d19a-48e8-8e14-a9ce41059b85 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054190 Jun 16 16:21:15.841782 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 458/905] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:21:15.876675 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-10a7ffa2-6a33-4403-9b83-fa3b8d83524e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:15.877326 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-10a7ffa2-6a33-4403-9b83-fa3b8d83524e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:15.885161 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-10a7ffa2-6a33-4403-9b83-fa3b8d83524e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:15.886272 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-10a7ffa2-6a33-4403-9b83-fa3b8d83524e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:15.887689 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-10a7ffa2-6a33-4403-9b83-fa3b8d83524e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:15.888477 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-10a7ffa2-6a33-4403-9b83-fa3b8d83524e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:16.196256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-10a7ffa2-6a33-4403-9b83-fa3b8d83524e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:16.208644 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-10a7ffa2-6a33-4403-9b83-fa3b8d83524e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:16.210496 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-10a7ffa2-6a33-4403-9b83-fa3b8d83524e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:16.212095 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-10a7ffa2-6a33-4403-9b83-fa3b8d83524e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1720 microversion: 2.20 time: 0.340311 Jun 16 16:21:16.212791 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 448/906] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:15 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1720 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:17.243768 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a893df08-5860-4d34-8469-fbaa6690a095 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:17.245081 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a893df08-5860-4d34-8469-fbaa6690a095 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:17.261273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a893df08-5860-4d34-8469-fbaa6690a095 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:17.261616 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a893df08-5860-4d34-8469-fbaa6690a095 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:17.263896 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a893df08-5860-4d34-8469-fbaa6690a095 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:17.265218 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a893df08-5860-4d34-8469-fbaa6690a095 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:17.557832 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a893df08-5860-4d34-8469-fbaa6690a095 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:17.569840 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a893df08-5860-4d34-8469-fbaa6690a095 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:17.572647 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a893df08-5860-4d34-8469-fbaa6690a095 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:17.574461 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a893df08-5860-4d34-8469-fbaa6690a095 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1663 microversion: 2.20 time: 0.344954 Jun 16 16:21:17.575707 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 459/907] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:17 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1663 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:17.595703 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ec9aa0cb-1026-4255-ad05-9a209aa27825 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7786994e-da0f-4109-9902-51048ab24c94"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:17.597326 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ec9aa0cb-1026-4255-ad05-9a209aa27825 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:17.605756 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec9aa0cb-1026-4255-ad05-9a209aa27825 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:17.607513 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec9aa0cb-1026-4255-ad05-9a209aa27825 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:17.608675 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec9aa0cb-1026-4255-ad05-9a209aa27825 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:17.609319 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec9aa0cb-1026-4255-ad05-9a209aa27825 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:18.152181 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ec9aa0cb-1026-4255-ad05-9a209aa27825 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "POST /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.562437 Jun 16 16:21:18.152806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 449/908] 10.222.0.17 () {62 vars in 1363 bytes} [Thu Jun 16 16:21:17 2022] POST /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/os-volume_attachments => generated 188 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:21:18.376328 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c4bc4094-eea6-4b3c-b985-e601818249a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:18.377016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c4bc4094-eea6-4b3c-b985-e601818249a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:18.385702 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c4bc4094-eea6-4b3c-b985-e601818249a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:18.386297 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c4bc4094-eea6-4b3c-b985-e601818249a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:18.387185 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c4bc4094-eea6-4b3c-b985-e601818249a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:18.387870 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c4bc4094-eea6-4b3c-b985-e601818249a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:18.559074 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-370ea3d9-95ad-415d-b6bf-fa5d9b17ede1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Action: 'create', calling method: .version_select at 0x7f38bb74bc10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1070108778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0jKViy4J4ixA4Jo37sdcLQUk0CEV5VKr8ahB9vxtpbTYBGCYZakuyWeDen7H/8Pi9MOxrmPwT8RLjj3HlpMRvn6YBc5r/EaxiuTzzX9EfpXeTWHg7XFKftPbfEytvPxQ=="}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:18.561366 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c4bc4094-eea6-4b3c-b985-e601818249a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "POST /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/action" status: 202 len: 0 microversion: 2.20 time: 0.190314 Jun 16 16:21:18.565476 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 450/909] 10.222.0.17 () {62 vars in 1318 bytes} [Thu Jun 16 16:21:18 2022] POST /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:21:18.571282 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-af1e5861-ee91-481e-81cc-2c8f12436929 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:18.571900 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-af1e5861-ee91-481e-81cc-2c8f12436929 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:18.580126 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af1e5861-ee91-481e-81cc-2c8f12436929 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:18.581123 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af1e5861-ee91-481e-81cc-2c8f12436929 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:18.582342 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af1e5861-ee91-481e-81cc-2c8f12436929 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:18.582948 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-af1e5861-ee91-481e-81cc-2c8f12436929 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:18.588380 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-370ea3d9-95ad-415d-b6bf-fa5d9b17ede1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Getting quotas for project b77126371c5d44db8ab75fbfca0737af. Resources: {'key_pairs'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:21:18.595666 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-370ea3d9-95ad-415d-b6bf-fa5d9b17ede1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Getting quotas for user 373d58e9f0e6472dad412ac02bff2b94 and project b77126371c5d44db8ab75fbfca0737af. Resources: {'key_pairs'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:21:18.644295 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-370ea3d9-95ad-415d-b6bf-fa5d9b17ede1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.411908 Jun 16 16:21:18.645989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 460/910] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 16:21:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:18.858049 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-af1e5861-ee91-481e-81cc-2c8f12436929 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:18.879009 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-af1e5861-ee91-481e-81cc-2c8f12436929 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:18.882514 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-af1e5861-ee91-481e-81cc-2c8f12436929 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:18.884964 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-af1e5861-ee91-481e-81cc-2c8f12436929 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1749 microversion: 2.20 time: 0.317924 Jun 16 16:21:18.899025 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 451/911] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:18 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1749 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:19.913362 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fdb09095-175a-47f4-8be8-187de4ef449a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:19.914036 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-fdb09095-175a-47f4-8be8-187de4ef449a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:19.925700 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fdb09095-175a-47f4-8be8-187de4ef449a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:19.926360 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fdb09095-175a-47f4-8be8-187de4ef449a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:19.927134 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fdb09095-175a-47f4-8be8-187de4ef449a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:19.927635 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fdb09095-175a-47f4-8be8-187de4ef449a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:20.136749 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fdb09095-175a-47f4-8be8-187de4ef449a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:20.151004 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fdb09095-175a-47f4-8be8-187de4ef449a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:20.153646 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fdb09095-175a-47f4-8be8-187de4ef449a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:20.156137 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fdb09095-175a-47f4-8be8-187de4ef449a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1749 microversion: 2.20 time: 0.247292 Jun 16 16:21:20.157250 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 461/912] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:19 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1749 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:21.182960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-58dd281d-2742-4830-9d9b-7d586386ba93 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:21.183684 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-58dd281d-2742-4830-9d9b-7d586386ba93 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:21.191381 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58dd281d-2742-4830-9d9b-7d586386ba93 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:21.191830 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58dd281d-2742-4830-9d9b-7d586386ba93 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:21.192741 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58dd281d-2742-4830-9d9b-7d586386ba93 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:21.193059 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-58dd281d-2742-4830-9d9b-7d586386ba93 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:21.379118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-58dd281d-2742-4830-9d9b-7d586386ba93 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:21.389741 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-58dd281d-2742-4830-9d9b-7d586386ba93 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:21.391310 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-58dd281d-2742-4830-9d9b-7d586386ba93 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:21.392537 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-58dd281d-2742-4830-9d9b-7d586386ba93 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.213642 Jun 16 16:21:21.393320 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 452/913] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:21 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:22.414657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-bda1aa31-c749-4ea2-90b0-0488b023286c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:22.415606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-bda1aa31-c749-4ea2-90b0-0488b023286c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:22.424084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-bda1aa31-c749-4ea2-90b0-0488b023286c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:22.424550 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-bda1aa31-c749-4ea2-90b0-0488b023286c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:22.425514 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-bda1aa31-c749-4ea2-90b0-0488b023286c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:22.425979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-bda1aa31-c749-4ea2-90b0-0488b023286c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:22.610743 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-bda1aa31-c749-4ea2-90b0-0488b023286c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:22.621024 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-bda1aa31-c749-4ea2-90b0-0488b023286c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:22.624170 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-bda1aa31-c749-4ea2-90b0-0488b023286c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:22.625551 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-bda1aa31-c749-4ea2-90b0-0488b023286c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.216400 Jun 16 16:21:22.626208 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 462/914] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:22 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:23.662006 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b6271ed9-e520-46ac-a523-edf4af1417fc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:23.664009 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b6271ed9-e520-46ac-a523-edf4af1417fc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:23.681275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6271ed9-e520-46ac-a523-edf4af1417fc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:23.683007 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6271ed9-e520-46ac-a523-edf4af1417fc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:23.685106 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6271ed9-e520-46ac-a523-edf4af1417fc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:23.694154 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b6271ed9-e520-46ac-a523-edf4af1417fc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:23.694154 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:24.061051 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b6271ed9-e520-46ac-a523-edf4af1417fc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:24.089253 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b6271ed9-e520-46ac-a523-edf4af1417fc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:24.092775 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b6271ed9-e520-46ac-a523-edf4af1417fc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:24.094661 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b6271ed9-e520-46ac-a523-edf4af1417fc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.441567 Jun 16 16:21:24.096248 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 453/915] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:23 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:25.126202 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7955ddab-e280-4222-a38e-392fc70838e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:25.127636 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7955ddab-e280-4222-a38e-392fc70838e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:25.148279 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7955ddab-e280-4222-a38e-392fc70838e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:25.148964 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7955ddab-e280-4222-a38e-392fc70838e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:25.149943 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7955ddab-e280-4222-a38e-392fc70838e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:25.150548 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7955ddab-e280-4222-a38e-392fc70838e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:25.481392 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7955ddab-e280-4222-a38e-392fc70838e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:25.500457 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7955ddab-e280-4222-a38e-392fc70838e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:25.506925 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7955ddab-e280-4222-a38e-392fc70838e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:25.508352 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7955ddab-e280-4222-a38e-392fc70838e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.388278 Jun 16 16:21:25.513864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 463/916] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:25 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:21:26.537571 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-daa64cc9-6162-4806-93a3-189e9a9d2e3a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:26.539550 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-daa64cc9-6162-4806-93a3-189e9a9d2e3a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:26.554789 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=30 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:26.560513 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-daa64cc9-6162-4806-93a3-189e9a9d2e3a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:26.561685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-daa64cc9-6162-4806-93a3-189e9a9d2e3a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:26.563360 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-daa64cc9-6162-4806-93a3-189e9a9d2e3a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:26.564337 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-daa64cc9-6162-4806-93a3-189e9a9d2e3a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:26.875263 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-daa64cc9-6162-4806-93a3-189e9a9d2e3a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:26.884969 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-daa64cc9-6162-4806-93a3-189e9a9d2e3a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:26.886977 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-daa64cc9-6162-4806-93a3-189e9a9d2e3a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:26.888938 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-daa64cc9-6162-4806-93a3-189e9a9d2e3a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.356570 Jun 16 16:21:26.894691 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 454/917] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:26 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:27.846045 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-836187319", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-229178973", "security_groups": [{"name": "tempest-secgroup-smoke-1219751689"}], "networks": [{"uuid": "98d47326-345f-472c-9d56-0482f40e4abd"}], "block_device_mapping_v2": [{"uuid": "986009dd-af62-4ae3-892f-2282c041e555", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:27.855285 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:27.913060 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-15d74bae-f525-4514-9f0c-aee93aa2c220 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:27.914619 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-15d74bae-f525-4514-9f0c-aee93aa2c220 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:27.923889 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-15d74bae-f525-4514-9f0c-aee93aa2c220 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:27.924800 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-15d74bae-f525-4514-9f0c-aee93aa2c220 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:27.925812 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-15d74bae-f525-4514-9f0c-aee93aa2c220 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:27.926818 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-15d74bae-f525-4514-9f0c-aee93aa2c220 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:28.021696 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.network.neutron [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] validate_networks() for [('98d47326-345f-472c-9d56-0482f40e4abd', None, None, None, None, None)] {{(pid=117756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:21:28.132143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-15d74bae-f525-4514-9f0c-aee93aa2c220 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:28.143453 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-15d74bae-f525-4514-9f0c-aee93aa2c220 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:28.145268 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-15d74bae-f525-4514-9f0c-aee93aa2c220 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:28.147280 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-15d74bae-f525-4514-9f0c-aee93aa2c220 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.238158 Jun 16 16:21:28.148969 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 455/918] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:27 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:28.610699 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=4 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:28.814223 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Flavor limits 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:21:28.814931 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Image limits 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:21:28.815747 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Flavor pref 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:21:28.816526 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Image pref 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:21:28.817143 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:21:28.831833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:28.832636 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:28.835381 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:28.835381 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:28.861102 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Getting quotas for project bd7ec755d96f4dee964a003d6c269c4e. Resources: {'instances', 'cores', 'ram'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:21:28.866209 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Getting quotas for user 080c7129a52e49c698cb2dc4afe14de7 and project bd7ec755d96f4dee964a003d6c269c4e. Resources: {'instances', 'cores', 'ram'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:21:28.944564 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Going to run 1 instances... {{(pid=117756) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:21:28.946974 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='986009dd-af62-4ae3-892f-2282c041e555',volume_size=None,volume_type=None)] {{(pid=117756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:21:29.116944 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-98b27c39-a1c7-4a05-aad4-d000594737c2 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.275310 Jun 16 16:21:29.118229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 464/919] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:21:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:21:29.135969 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f235af20-bcd3-401d-bbe7-ec5244c41e25 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:29.137225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f235af20-bcd3-401d-bbe7-ec5244c41e25 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:29.168992 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-37026b58-76fe-43e7-845f-490b6e1be2c1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:29.181239 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-37026b58-76fe-43e7-845f-490b6e1be2c1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:29.204204 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-37026b58-76fe-43e7-845f-490b6e1be2c1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:29.204775 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-37026b58-76fe-43e7-845f-490b6e1be2c1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:29.205672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-37026b58-76fe-43e7-845f-490b6e1be2c1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:29.206419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-37026b58-76fe-43e7-845f-490b6e1be2c1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:29.242322 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f235af20-bcd3-401d-bbe7-ec5244c41e25 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:29.252457 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f235af20-bcd3-401d-bbe7-ec5244c41e25 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1087 microversion: 2.1 time: 0.119950 Jun 16 16:21:29.254273 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 456/920] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:29 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1087 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:29.446503 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-37026b58-76fe-43e7-845f-490b6e1be2c1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:29.456584 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-37026b58-76fe-43e7-845f-490b6e1be2c1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:29.458412 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-37026b58-76fe-43e7-845f-490b6e1be2c1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:29.460324 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-37026b58-76fe-43e7-845f-490b6e1be2c1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.295542 Jun 16 16:21:29.472436 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 465/921] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:29 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:30.273045 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8b8972e1-07ab-421a-9f26-8123aeae6f39 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:30.273700 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8b8972e1-07ab-421a-9f26-8123aeae6f39 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:30.281720 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b8972e1-07ab-421a-9f26-8123aeae6f39 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:30.282278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b8972e1-07ab-421a-9f26-8123aeae6f39 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:30.283310 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b8972e1-07ab-421a-9f26-8123aeae6f39 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:30.283911 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8b8972e1-07ab-421a-9f26-8123aeae6f39 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:30.355853 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8b8972e1-07ab-421a-9f26-8123aeae6f39 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:30.365682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8b8972e1-07ab-421a-9f26-8123aeae6f39 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1137 microversion: 2.1 time: 0.096696 Jun 16 16:21:30.366049 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 457/922] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:30 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1137 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:30.480556 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c9458974-6cf7-4943-bc85-20e4a0ff51a5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:30.481331 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c9458974-6cf7-4943-bc85-20e4a0ff51a5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:30.490069 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c9458974-6cf7-4943-bc85-20e4a0ff51a5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:30.490526 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c9458974-6cf7-4943-bc85-20e4a0ff51a5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:30.491318 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c9458974-6cf7-4943-bc85-20e4a0ff51a5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:30.491768 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c9458974-6cf7-4943-bc85-20e4a0ff51a5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:30.685856 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c9458974-6cf7-4943-bc85-20e4a0ff51a5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:30.701207 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c9458974-6cf7-4943-bc85-20e4a0ff51a5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:30.702974 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c9458974-6cf7-4943-bc85-20e4a0ff51a5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:30.704213 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c9458974-6cf7-4943-bc85-20e4a0ff51a5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.227848 Jun 16 16:21:30.704784 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 466/923] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:30 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:31.394084 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f239c360-1ed6-46da-9373-eaf193ddc764 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:31.396613 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f239c360-1ed6-46da-9373-eaf193ddc764 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:31.409987 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f239c360-1ed6-46da-9373-eaf193ddc764 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:31.411098 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f239c360-1ed6-46da-9373-eaf193ddc764 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:31.412663 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f239c360-1ed6-46da-9373-eaf193ddc764 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:31.413647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f239c360-1ed6-46da-9373-eaf193ddc764 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:31.519673 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f239c360-1ed6-46da-9373-eaf193ddc764 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:31.530725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f239c360-1ed6-46da-9373-eaf193ddc764 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1137 microversion: 2.1 time: 0.148408 Jun 16 16:21:31.531677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 458/924] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:31 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1137 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:31.728413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e143911e-7c42-4d23-87ec-5bb94a95ce1e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:31.729919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e143911e-7c42-4d23-87ec-5bb94a95ce1e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:31.745065 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e143911e-7c42-4d23-87ec-5bb94a95ce1e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:31.746089 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e143911e-7c42-4d23-87ec-5bb94a95ce1e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:31.747766 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e143911e-7c42-4d23-87ec-5bb94a95ce1e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:31.748497 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e143911e-7c42-4d23-87ec-5bb94a95ce1e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:31.953111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e143911e-7c42-4d23-87ec-5bb94a95ce1e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:31.962269 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e143911e-7c42-4d23-87ec-5bb94a95ce1e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:31.963989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e143911e-7c42-4d23-87ec-5bb94a95ce1e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:31.965472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e143911e-7c42-4d23-87ec-5bb94a95ce1e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.241128 Jun 16 16:21:31.967549 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 467/925] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:31 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:32.549028 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7265a50f-890f-450b-bfeb-2824167f8509 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:32.549676 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7265a50f-890f-450b-bfeb-2824167f8509 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:32.555915 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7265a50f-890f-450b-bfeb-2824167f8509 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:32.556499 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7265a50f-890f-450b-bfeb-2824167f8509 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:32.557397 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7265a50f-890f-450b-bfeb-2824167f8509 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:32.557832 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7265a50f-890f-450b-bfeb-2824167f8509 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:32.636593 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7265a50f-890f-450b-bfeb-2824167f8509 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:32.646228 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7265a50f-890f-450b-bfeb-2824167f8509 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1137 microversion: 2.1 time: 0.102233 Jun 16 16:21:32.646878 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 459/926] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:32 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1137 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:32.986304 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-5e9ec7b7-e84c-4b9f-97f3-3345159d6524 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:32.987227 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-5e9ec7b7-e84c-4b9f-97f3-3345159d6524 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:32.994727 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5e9ec7b7-e84c-4b9f-97f3-3345159d6524 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:32.995182 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5e9ec7b7-e84c-4b9f-97f3-3345159d6524 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:32.995975 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5e9ec7b7-e84c-4b9f-97f3-3345159d6524 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:32.996426 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5e9ec7b7-e84c-4b9f-97f3-3345159d6524 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:33.158164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5e9ec7b7-e84c-4b9f-97f3-3345159d6524 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:33.171532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5e9ec7b7-e84c-4b9f-97f3-3345159d6524 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:33.173055 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5e9ec7b7-e84c-4b9f-97f3-3345159d6524 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:33.174311 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-5e9ec7b7-e84c-4b9f-97f3-3345159d6524 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.192739 Jun 16 16:21:33.174894 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 468/927] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:32 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:33.663680 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ec79cacc-3653-4375-80dc-fc0611234af7 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:33.664457 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ec79cacc-3653-4375-80dc-fc0611234af7 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:33.673051 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec79cacc-3653-4375-80dc-fc0611234af7 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:33.673633 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec79cacc-3653-4375-80dc-fc0611234af7 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:33.674679 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec79cacc-3653-4375-80dc-fc0611234af7 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:33.675114 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ec79cacc-3653-4375-80dc-fc0611234af7 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:33.768997 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ec79cacc-3653-4375-80dc-fc0611234af7 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:33.781417 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ec79cacc-3653-4375-80dc-fc0611234af7 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1193 microversion: 2.1 time: 0.121322 Jun 16 16:21:33.783154 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 460/928] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:33 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1193 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:34.194329 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6074bddd-2a85-4f01-b036-42d1332e9783 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:34.195024 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6074bddd-2a85-4f01-b036-42d1332e9783 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:34.202131 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6074bddd-2a85-4f01-b036-42d1332e9783 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:34.202599 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6074bddd-2a85-4f01-b036-42d1332e9783 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:34.203501 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6074bddd-2a85-4f01-b036-42d1332e9783 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:34.203967 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6074bddd-2a85-4f01-b036-42d1332e9783 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:34.451606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6074bddd-2a85-4f01-b036-42d1332e9783 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:34.467296 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6074bddd-2a85-4f01-b036-42d1332e9783 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:34.470244 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6074bddd-2a85-4f01-b036-42d1332e9783 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:34.472356 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6074bddd-2a85-4f01-b036-42d1332e9783 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.282767 Jun 16 16:21:34.473557 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 469/929] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:34 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:34.800606 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2b75a070-b004-4125-95ec-cd759bd56b10 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:34.802899 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2b75a070-b004-4125-95ec-cd759bd56b10 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:34.814524 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2b75a070-b004-4125-95ec-cd759bd56b10 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:34.816538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2b75a070-b004-4125-95ec-cd759bd56b10 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:34.817698 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2b75a070-b004-4125-95ec-cd759bd56b10 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:34.818186 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2b75a070-b004-4125-95ec-cd759bd56b10 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:34.979123 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2b75a070-b004-4125-95ec-cd759bd56b10 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:34.988933 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2b75a070-b004-4125-95ec-cd759bd56b10 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1259 microversion: 2.1 time: 0.193127 Jun 16 16:21:34.999075 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 461/930] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:34 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:35.492559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-dc75a751-17ab-4579-9df3-4c484956a5ff tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:35.493280 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-dc75a751-17ab-4579-9df3-4c484956a5ff tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:35.506152 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dc75a751-17ab-4579-9df3-4c484956a5ff tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:35.507081 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dc75a751-17ab-4579-9df3-4c484956a5ff tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:35.507996 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dc75a751-17ab-4579-9df3-4c484956a5ff tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:35.508672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dc75a751-17ab-4579-9df3-4c484956a5ff tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:35.710354 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-dc75a751-17ab-4579-9df3-4c484956a5ff tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:35.721733 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-dc75a751-17ab-4579-9df3-4c484956a5ff tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:35.723344 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-dc75a751-17ab-4579-9df3-4c484956a5ff tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:35.724565 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-dc75a751-17ab-4579-9df3-4c484956a5ff tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.236076 Jun 16 16:21:35.725304 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 470/931] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:35 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:35.836971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-a9057a81-0d22-4df2-a63f-a63b04110090 req-9e948fa2-0ec8-4861-9949-533dae2c3123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3edfd3e1-fd3e-4455-a860-d55a2f67ef3d", "tag": "d9220eec-1f6d-431f-9e5e-4374035faf5f"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:35.857404 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-a9057a81-0d22-4df2-a63f-a63b04110090 req-9e948fa2-0ec8-4861-9949-533dae2c3123 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:35.858512 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-a9057a81-0d22-4df2-a63f-a63b04110090 req-9e948fa2-0ec8-4861-9949-533dae2c3123 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:35.880996 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-a9057a81-0d22-4df2-a63f-a63b04110090 req-9e948fa2-0ec8-4861-9949-533dae2c3123 service nova] Creating event network-changed:d9220eec-1f6d-431f-9e5e-4374035faf5f for instance 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d on hv-cinder-83716 Jun 16 16:21:35.887093 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-a9057a81-0d22-4df2-a63f-a63b04110090 req-9e948fa2-0ec8-4861-9949-533dae2c3123 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055807 Jun 16 16:21:35.888977 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 462/932] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:36.005737 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c4af795a-adfb-404e-a53f-df35e788abdd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:36.006403 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c4af795a-adfb-404e-a53f-df35e788abdd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:36.013508 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c4af795a-adfb-404e-a53f-df35e788abdd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:36.014000 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c4af795a-adfb-404e-a53f-df35e788abdd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:36.015026 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c4af795a-adfb-404e-a53f-df35e788abdd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:36.015533 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c4af795a-adfb-404e-a53f-df35e788abdd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:36.258989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-c4af795a-adfb-404e-a53f-df35e788abdd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:36.267536 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c4af795a-adfb-404e-a53f-df35e788abdd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1259 microversion: 2.1 time: 0.265715 Jun 16 16:21:36.268722 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 471/933] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:36 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1259 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:36.744917 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-27d8100d-68af-49ef-a78c-de08626dd066 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:36.745660 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-27d8100d-68af-49ef-a78c-de08626dd066 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:36.754848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-27d8100d-68af-49ef-a78c-de08626dd066 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:36.755300 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-27d8100d-68af-49ef-a78c-de08626dd066 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:36.756078 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-27d8100d-68af-49ef-a78c-de08626dd066 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:36.756512 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-27d8100d-68af-49ef-a78c-de08626dd066 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:36.901283 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-27d8100d-68af-49ef-a78c-de08626dd066 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:36.912138 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-27d8100d-68af-49ef-a78c-de08626dd066 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:36.913649 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-27d8100d-68af-49ef-a78c-de08626dd066 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:36.915086 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-27d8100d-68af-49ef-a78c-de08626dd066 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.174683 Jun 16 16:21:36.915668 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 463/934] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:36 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:37.286111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-823a417f-4282-41c2-a3de-025e33bb5805 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:37.286841 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-823a417f-4282-41c2-a3de-025e33bb5805 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:37.293545 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-823a417f-4282-41c2-a3de-025e33bb5805 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:37.294805 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-823a417f-4282-41c2-a3de-025e33bb5805 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:37.295428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-823a417f-4282-41c2-a3de-025e33bb5805 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:37.295875 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-823a417f-4282-41c2-a3de-025e33bb5805 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:37.451881 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-823a417f-4282-41c2-a3de-025e33bb5805 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:37.459590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-823a417f-4282-41c2-a3de-025e33bb5805 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1259 microversion: 2.1 time: 0.178478 Jun 16 16:21:37.460173 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 472/935] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:37 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:37.934751 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7abc18f9-b4d8-4327-a5d2-6d9bbc64d2df tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:37.935640 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7abc18f9-b4d8-4327-a5d2-6d9bbc64d2df tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:37.943271 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7abc18f9-b4d8-4327-a5d2-6d9bbc64d2df tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:37.943725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7abc18f9-b4d8-4327-a5d2-6d9bbc64d2df tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:37.944501 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7abc18f9-b4d8-4327-a5d2-6d9bbc64d2df tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:37.944945 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7abc18f9-b4d8-4327-a5d2-6d9bbc64d2df tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:38.081521 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7abc18f9-b4d8-4327-a5d2-6d9bbc64d2df tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:38.091355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7abc18f9-b4d8-4327-a5d2-6d9bbc64d2df tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:38.092877 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-7abc18f9-b4d8-4327-a5d2-6d9bbc64d2df tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:38.094081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7abc18f9-b4d8-4327-a5d2-6d9bbc64d2df tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.163677 Jun 16 16:21:38.094648 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 464/936] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:37 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:38.477050 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d85a6392-007c-4be8-b665-f4484b95c3c6 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:38.477737 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d85a6392-007c-4be8-b665-f4484b95c3c6 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:38.484228 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d85a6392-007c-4be8-b665-f4484b95c3c6 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:38.484662 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d85a6392-007c-4be8-b665-f4484b95c3c6 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:38.485603 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d85a6392-007c-4be8-b665-f4484b95c3c6 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:38.486130 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d85a6392-007c-4be8-b665-f4484b95c3c6 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:38.631709 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d85a6392-007c-4be8-b665-f4484b95c3c6 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:38.644185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d85a6392-007c-4be8-b665-f4484b95c3c6 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1259 microversion: 2.1 time: 0.170745 Jun 16 16:21:38.645098 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 473/937] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:38 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:39.112559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3fb158f2-a3e8-4d78-8d38-920375e6c764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:39.113170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3fb158f2-a3e8-4d78-8d38-920375e6c764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:39.119791 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3fb158f2-a3e8-4d78-8d38-920375e6c764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:39.120235 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3fb158f2-a3e8-4d78-8d38-920375e6c764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:39.121025 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3fb158f2-a3e8-4d78-8d38-920375e6c764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:39.121467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3fb158f2-a3e8-4d78-8d38-920375e6c764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:39.257273 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=2 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:39.267540 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3fb158f2-a3e8-4d78-8d38-920375e6c764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:39.276017 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3fb158f2-a3e8-4d78-8d38-920375e6c764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:39.277602 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3fb158f2-a3e8-4d78-8d38-920375e6c764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:39.279532 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3fb158f2-a3e8-4d78-8d38-920375e6c764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.170933 Jun 16 16:21:39.280248 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 465/938] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:39 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:39.354556 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1014338650", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1070108778", "security_groups": [{"name": "tempest-secgroup-smoke-1016408516"}], "block_device_mapping_v2": [{"uuid": "8e77c0b4-2a89-4478-a927-b4361ebddc21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8adc531-7e83-47cd-8743-c56fb61916fb"}]}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:39.363521 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:39.364176 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=6 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:39.479473 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.network.neutron [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] validate_networks() for [('c8adc531-7e83-47cd-8743-c56fb61916fb', None, None, None, None, None)] {{(pid=117756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:21:39.668000 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d87ea65a-765d-40fa-9292-8d23c3548d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:39.668965 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d87ea65a-765d-40fa-9292-8d23c3548d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:39.676041 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d87ea65a-765d-40fa-9292-8d23c3548d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:39.676497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d87ea65a-765d-40fa-9292-8d23c3548d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:39.677460 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d87ea65a-765d-40fa-9292-8d23c3548d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:39.677908 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d87ea65a-765d-40fa-9292-8d23c3548d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:39.825946 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d87ea65a-765d-40fa-9292-8d23c3548d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:39.833499 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d87ea65a-765d-40fa-9292-8d23c3548d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1259 microversion: 2.1 time: 0.169389 Jun 16 16:21:39.834100 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 466/939] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:39 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:39.866573 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Flavor limits 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:21:39.867034 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Image limits 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:21:39.867633 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Flavor pref 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:21:39.867908 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Image pref 0:0:0 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:21:39.868311 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.virt.hardware [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:21:39.878242 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:39.878687 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:39.879479 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:39.879910 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:39.896777 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Getting quotas for project b77126371c5d44db8ab75fbfca0737af. Resources: {'instances', 'cores', 'ram'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:21:39.900746 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Getting quotas for user 373d58e9f0e6472dad412ac02bff2b94 and project b77126371c5d44db8ab75fbfca0737af. Resources: {'instances', 'cores', 'ram'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:21:39.959100 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Going to run 1 instances... {{(pid=117756) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:21:39.961127 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e77c0b4-2a89-4478-a927-b4361ebddc21',volume_size=None,volume_type=None)] {{(pid=117756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:21:40.097108 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-66a7edf7-6bba-4248-be63-da2fbeea518c tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.746223 Jun 16 16:21:40.097771 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 474/940] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:21:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:21:40.107895 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3cdd4994-ef08-4769-802b-b65e9905c820 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:40.108506 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3cdd4994-ef08-4769-802b-b65e9905c820 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:40.163985 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3cdd4994-ef08-4769-802b-b65e9905c820 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:40.171259 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3cdd4994-ef08-4769-802b-b65e9905c820 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1095 microversion: 2.1 time: 0.067336 Jun 16 16:21:40.171916 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 467/941] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:40 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:40.299547 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-0d3ee7cb-af61-475d-8155-82bcc0233db4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:40.300390 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-0d3ee7cb-af61-475d-8155-82bcc0233db4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:40.307509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0d3ee7cb-af61-475d-8155-82bcc0233db4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:40.307953 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0d3ee7cb-af61-475d-8155-82bcc0233db4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:40.308741 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0d3ee7cb-af61-475d-8155-82bcc0233db4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:40.309198 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0d3ee7cb-af61-475d-8155-82bcc0233db4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:40.454250 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-0d3ee7cb-af61-475d-8155-82bcc0233db4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:40.463411 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-0d3ee7cb-af61-475d-8155-82bcc0233db4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:40.464919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-0d3ee7cb-af61-475d-8155-82bcc0233db4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:40.466394 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-0d3ee7cb-af61-475d-8155-82bcc0233db4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.171619 Jun 16 16:21:40.467022 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 475/942] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:40 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:40.850669 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d28df9bc-cd61-455d-ae4f-83d4e1152c64 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:40.851292 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d28df9bc-cd61-455d-ae4f-83d4e1152c64 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:40.858827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d28df9bc-cd61-455d-ae4f-83d4e1152c64 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:40.859283 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d28df9bc-cd61-455d-ae4f-83d4e1152c64 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:40.860063 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d28df9bc-cd61-455d-ae4f-83d4e1152c64 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:40.860504 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d28df9bc-cd61-455d-ae4f-83d4e1152c64 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:41.068949 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d28df9bc-cd61-455d-ae4f-83d4e1152c64 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:41.077340 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d28df9bc-cd61-455d-ae4f-83d4e1152c64 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1259 microversion: 2.1 time: 0.230764 Jun 16 16:21:41.086112 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 468/943] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:40 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:41.189501 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-45ad5c70-aa61-43cb-b2d4-0d9670a7c23b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:41.191497 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-45ad5c70-aa61-43cb-b2d4-0d9670a7c23b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:41.198422 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-45ad5c70-aa61-43cb-b2d4-0d9670a7c23b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:41.199121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-45ad5c70-aa61-43cb-b2d4-0d9670a7c23b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:41.200294 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-45ad5c70-aa61-43cb-b2d4-0d9670a7c23b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:41.200702 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-45ad5c70-aa61-43cb-b2d4-0d9670a7c23b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:41.306223 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-45ad5c70-aa61-43cb-b2d4-0d9670a7c23b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:41.314330 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-45ad5c70-aa61-43cb-b2d4-0d9670a7c23b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1211 microversion: 2.1 time: 0.130766 Jun 16 16:21:41.315164 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 476/944] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:41 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1211 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:21:41.485453 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-57a48c0a-6a06-4fd9-8146-c64c75770d02 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:41.486432 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-57a48c0a-6a06-4fd9-8146-c64c75770d02 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:41.494222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-57a48c0a-6a06-4fd9-8146-c64c75770d02 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:41.494863 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-57a48c0a-6a06-4fd9-8146-c64c75770d02 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:41.495656 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-57a48c0a-6a06-4fd9-8146-c64c75770d02 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:41.496299 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-57a48c0a-6a06-4fd9-8146-c64c75770d02 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:41.663319 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-57a48c0a-6a06-4fd9-8146-c64c75770d02 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:41.680242 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-57a48c0a-6a06-4fd9-8146-c64c75770d02 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:41.683426 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-57a48c0a-6a06-4fd9-8146-c64c75770d02 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:41.685954 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-57a48c0a-6a06-4fd9-8146-c64c75770d02 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.204756 Jun 16 16:21:41.698160 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 469/945] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:41 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:42.094721 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-77a1654e-d053-434a-a1f1-b44033321422 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:42.095338 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-77a1654e-d053-434a-a1f1-b44033321422 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:42.103565 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77a1654e-d053-434a-a1f1-b44033321422 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:42.104958 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77a1654e-d053-434a-a1f1-b44033321422 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:42.105806 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77a1654e-d053-434a-a1f1-b44033321422 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:42.107033 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-77a1654e-d053-434a-a1f1-b44033321422 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:42.254099 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-77a1654e-d053-434a-a1f1-b44033321422 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:42.256373 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=100 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:42.263258 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-77a1654e-d053-434a-a1f1-b44033321422 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1259 microversion: 2.1 time: 0.172913 Jun 16 16:21:42.263838 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 477/946] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:42 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:42.332386 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-178256a7-c094-4e45-a234-2dd423a7214e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:42.333163 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-178256a7-c094-4e45-a234-2dd423a7214e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:42.339835 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-178256a7-c094-4e45-a234-2dd423a7214e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:42.340283 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-178256a7-c094-4e45-a234-2dd423a7214e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:42.341784 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-178256a7-c094-4e45-a234-2dd423a7214e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:42.342268 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-178256a7-c094-4e45-a234-2dd423a7214e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:42.501664 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-178256a7-c094-4e45-a234-2dd423a7214e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:42.511192 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-178256a7-c094-4e45-a234-2dd423a7214e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1279 microversion: 2.1 time: 0.182631 Jun 16 16:21:42.512098 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 470/947] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:42 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1279 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:42.708353 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a3e9a972-20d6-4eb4-82ea-393263c675fe tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:42.708987 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a3e9a972-20d6-4eb4-82ea-393263c675fe tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:42.716055 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a3e9a972-20d6-4eb4-82ea-393263c675fe tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:42.716851 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a3e9a972-20d6-4eb4-82ea-393263c675fe tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:42.717965 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a3e9a972-20d6-4eb4-82ea-393263c675fe tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:42.718930 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a3e9a972-20d6-4eb4-82ea-393263c675fe tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:42.970189 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a3e9a972-20d6-4eb4-82ea-393263c675fe tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:42.983236 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a3e9a972-20d6-4eb4-82ea-393263c675fe tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:42.990090 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a3e9a972-20d6-4eb4-82ea-393263c675fe tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:42.993562 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a3e9a972-20d6-4eb4-82ea-393263c675fe tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.288911 Jun 16 16:21:42.999485 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 478/948] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:42 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:43.187568 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-997ece10-9625-427e-9636-59126d3c2103 req-e3a3c333-be02-4312-bcaf-5c913d9ff16f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe449def-0ec0-4555-96d0-af4550c361cf", "tag": "ade79578-a8ae-4117-8223-b656f9d6481b"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:43.226040 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-997ece10-9625-427e-9636-59126d3c2103 req-e3a3c333-be02-4312-bcaf-5c913d9ff16f service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:43.228773 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-997ece10-9625-427e-9636-59126d3c2103 req-e3a3c333-be02-4312-bcaf-5c913d9ff16f service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:43.245497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-997ece10-9625-427e-9636-59126d3c2103 req-e3a3c333-be02-4312-bcaf-5c913d9ff16f service nova] Creating event network-changed:ade79578-a8ae-4117-8223-b656f9d6481b for instance fe449def-0ec0-4555-96d0-af4550c361cf on hv-cinder-83716 Jun 16 16:21:43.251450 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-997ece10-9625-427e-9636-59126d3c2103 req-e3a3c333-be02-4312-bcaf-5c913d9ff16f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069934 Jun 16 16:21:43.252518 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 471/949] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:21:43.281008 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-56838a60-61b1-42e9-8c57-63d2e3b6ef3f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:43.281852 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-56838a60-61b1-42e9-8c57-63d2e3b6ef3f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:43.296363 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-56838a60-61b1-42e9-8c57-63d2e3b6ef3f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:43.296827 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-56838a60-61b1-42e9-8c57-63d2e3b6ef3f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:43.297625 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-56838a60-61b1-42e9-8c57-63d2e3b6ef3f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:43.298105 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-56838a60-61b1-42e9-8c57-63d2e3b6ef3f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:43.339562 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-f3e02cab-087b-449c-9129-b96b2777dfe4 req-d0145ba1-d12f-4074-8b7d-d6ffe94047d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4412fc83-e558-4531-8295-ee5a4f1ba983", "name": "network-vif-plugged", "status": "completed", "tag": "1f148a28-fe89-4254-bdba-5773896f6c82"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:43.354353 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-f3e02cab-087b-449c-9129-b96b2777dfe4 req-d0145ba1-d12f-4074-8b7d-d6ffe94047d0 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:43.355164 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-f3e02cab-087b-449c-9129-b96b2777dfe4 req-d0145ba1-d12f-4074-8b7d-d6ffe94047d0 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:43.367885 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-f3e02cab-087b-449c-9129-b96b2777dfe4 req-d0145ba1-d12f-4074-8b7d-d6ffe94047d0 service nova] Creating event network-vif-plugged:1f148a28-fe89-4254-bdba-5773896f6c82 for instance 4412fc83-e558-4531-8295-ee5a4f1ba983 on hv-cinder-83716 Jun 16 16:21:43.374488 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-f3e02cab-087b-449c-9129-b96b2777dfe4 req-d0145ba1-d12f-4074-8b7d-d6ffe94047d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039275 Jun 16 16:21:43.376723 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 472/950] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:21:43.520273 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-56838a60-61b1-42e9-8c57-63d2e3b6ef3f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:43.530908 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-496373d3-9149-4bf0-9dbc-0f1879547da9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:43.531656 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-496373d3-9149-4bf0-9dbc-0f1879547da9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:43.533057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-56838a60-61b1-42e9-8c57-63d2e3b6ef3f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1259 microversion: 2.1 time: 0.256628 Jun 16 16:21:43.533983 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 479/951] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:43 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1259 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:43.538607 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-496373d3-9149-4bf0-9dbc-0f1879547da9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:43.539016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-496373d3-9149-4bf0-9dbc-0f1879547da9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:43.539795 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-496373d3-9149-4bf0-9dbc-0f1879547da9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:43.540237 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-496373d3-9149-4bf0-9dbc-0f1879547da9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:43.707188 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-496373d3-9149-4bf0-9dbc-0f1879547da9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:43.709497 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=100 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:43.727083 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-496373d3-9149-4bf0-9dbc-0f1879547da9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1267 microversion: 2.1 time: 0.201849 Jun 16 16:21:43.727964 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 473/952] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:43 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:21:44.015886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f8566a83-4e26-4ff8-8745-39aa64eed2da tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:44.016567 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f8566a83-4e26-4ff8-8745-39aa64eed2da tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:44.024464 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f8566a83-4e26-4ff8-8745-39aa64eed2da tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:44.025268 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f8566a83-4e26-4ff8-8745-39aa64eed2da tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:44.026641 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f8566a83-4e26-4ff8-8745-39aa64eed2da tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:44.027313 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f8566a83-4e26-4ff8-8745-39aa64eed2da tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:44.190039 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f8566a83-4e26-4ff8-8745-39aa64eed2da tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:44.199373 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f8566a83-4e26-4ff8-8745-39aa64eed2da tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:44.200924 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f8566a83-4e26-4ff8-8745-39aa64eed2da tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:44.202148 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f8566a83-4e26-4ff8-8745-39aa64eed2da tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.191445 Jun 16 16:21:44.202770 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 480/953] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:44 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:44.550976 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bdfa5010-4f21-4460-90c1-7581896ad256 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:44.551834 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bdfa5010-4f21-4460-90c1-7581896ad256 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:44.558728 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bdfa5010-4f21-4460-90c1-7581896ad256 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:44.559311 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bdfa5010-4f21-4460-90c1-7581896ad256 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:44.560182 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bdfa5010-4f21-4460-90c1-7581896ad256 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:44.560617 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bdfa5010-4f21-4460-90c1-7581896ad256 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:44.716544 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bdfa5010-4f21-4460-90c1-7581896ad256 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:44.724650 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bdfa5010-4f21-4460-90c1-7581896ad256 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1259 microversion: 2.1 time: 0.177444 Jun 16 16:21:44.725237 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 474/954] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:44 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:44.746383 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-5b891fdc-0257-4462-b928-942a12c60708 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:44.748133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-5b891fdc-0257-4462-b928-942a12c60708 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:44.755832 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5b891fdc-0257-4462-b928-942a12c60708 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:44.756244 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5b891fdc-0257-4462-b928-942a12c60708 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:44.757129 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5b891fdc-0257-4462-b928-942a12c60708 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:44.757621 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5b891fdc-0257-4462-b928-942a12c60708 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:45.041484 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5b891fdc-0257-4462-b928-942a12c60708 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:45.055459 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-5b891fdc-0257-4462-b928-942a12c60708 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1267 microversion: 2.1 time: 0.313366 Jun 16 16:21:45.058272 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 481/955] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:44 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1267 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:45.222442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fdd1266a-33e6-4902-8ca7-201cba0ccdc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:45.223063 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fdd1266a-33e6-4902-8ca7-201cba0ccdc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:45.239427 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fdd1266a-33e6-4902-8ca7-201cba0ccdc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:45.240074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fdd1266a-33e6-4902-8ca7-201cba0ccdc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:45.241069 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fdd1266a-33e6-4902-8ca7-201cba0ccdc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:45.243971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fdd1266a-33e6-4902-8ca7-201cba0ccdc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:45.395830 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-25edeafc-17a2-4fe5-a711-6166fd72fa98 req-2d025acd-2f58-4aa7-bb20-596b235a5ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3edfd3e1-fd3e-4455-a860-d55a2f67ef3d", "name": "network-vif-plugged", "status": "completed", "tag": "d9220eec-1f6d-431f-9e5e-4374035faf5f"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:45.407221 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-25edeafc-17a2-4fe5-a711-6166fd72fa98 req-2d025acd-2f58-4aa7-bb20-596b235a5ef6 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:45.407680 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-25edeafc-17a2-4fe5-a711-6166fd72fa98 req-2d025acd-2f58-4aa7-bb20-596b235a5ef6 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:45.420795 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-25edeafc-17a2-4fe5-a711-6166fd72fa98 req-2d025acd-2f58-4aa7-bb20-596b235a5ef6 service nova] Creating event network-vif-plugged:d9220eec-1f6d-431f-9e5e-4374035faf5f for instance 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d on hv-cinder-83716 Jun 16 16:21:45.426941 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-25edeafc-17a2-4fe5-a711-6166fd72fa98 req-2d025acd-2f58-4aa7-bb20-596b235a5ef6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036620 Jun 16 16:21:45.427560 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 482/956] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:45.437111 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fdd1266a-33e6-4902-8ca7-201cba0ccdc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:45.446876 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fdd1266a-33e6-4902-8ca7-201cba0ccdc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:45.448412 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fdd1266a-33e6-4902-8ca7-201cba0ccdc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:45.449616 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fdd1266a-33e6-4902-8ca7-201cba0ccdc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1807 microversion: 2.20 time: 0.232183 Jun 16 16:21:45.452039 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 475/957] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:45 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1807 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:45.751019 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-90a305a0-8192-4bd5-97ff-f8f143c83841 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:45.752173 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-90a305a0-8192-4bd5-97ff-f8f143c83841 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:45.784828 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-90a305a0-8192-4bd5-97ff-f8f143c83841 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:45.786028 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-90a305a0-8192-4bd5-97ff-f8f143c83841 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:45.788431 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-90a305a0-8192-4bd5-97ff-f8f143c83841 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:45.789461 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-90a305a0-8192-4bd5-97ff-f8f143c83841 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:46.076526 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-00acb4ba-4e61-4b8d-9e17-d309d3335cd1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:46.078079 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-00acb4ba-4e61-4b8d-9e17-d309d3335cd1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:46.090021 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-00acb4ba-4e61-4b8d-9e17-d309d3335cd1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:46.091414 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-00acb4ba-4e61-4b8d-9e17-d309d3335cd1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:46.093092 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-00acb4ba-4e61-4b8d-9e17-d309d3335cd1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:46.094350 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-00acb4ba-4e61-4b8d-9e17-d309d3335cd1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:46.104938 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-90a305a0-8192-4bd5-97ff-f8f143c83841 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:46.114047 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-90a305a0-8192-4bd5-97ff-f8f143c83841 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1259 microversion: 2.1 time: 0.370044 Jun 16 16:21:46.125552 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 483/958] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:45 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1259 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:46.256838 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-00acb4ba-4e61-4b8d-9e17-d309d3335cd1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:46.265623 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-00acb4ba-4e61-4b8d-9e17-d309d3335cd1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1267 microversion: 2.1 time: 0.194622 Jun 16 16:21:46.266232 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 476/959] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:46 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:21:46.469719 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-72f25f77-b82f-40d9-b474-0c5f16e33b5a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:46.470360 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-72f25f77-b82f-40d9-b474-0c5f16e33b5a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:46.476500 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-72f25f77-b82f-40d9-b474-0c5f16e33b5a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:46.476954 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-72f25f77-b82f-40d9-b474-0c5f16e33b5a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:46.477746 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-72f25f77-b82f-40d9-b474-0c5f16e33b5a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:46.478214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-72f25f77-b82f-40d9-b474-0c5f16e33b5a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:46.624946 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-72f25f77-b82f-40d9-b474-0c5f16e33b5a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:46.633847 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-72f25f77-b82f-40d9-b474-0c5f16e33b5a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:46.635647 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-72f25f77-b82f-40d9-b474-0c5f16e33b5a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:46.636822 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-72f25f77-b82f-40d9-b474-0c5f16e33b5a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1794 microversion: 2.20 time: 0.171160 Jun 16 16:21:46.637619 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 484/960] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:21:46 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1794 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:21:47.131974 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-180c7d34-33b0-4505-9855-739b89aa4c2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:47.132596 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-180c7d34-33b0-4505-9855-739b89aa4c2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:47.140564 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-180c7d34-33b0-4505-9855-739b89aa4c2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:47.141072 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-180c7d34-33b0-4505-9855-739b89aa4c2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:47.141867 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-180c7d34-33b0-4505-9855-739b89aa4c2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:47.142326 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-180c7d34-33b0-4505-9855-739b89aa4c2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:47.283758 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8a7d44bf-18eb-42e9-87cb-95446d73c479 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:47.284791 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8a7d44bf-18eb-42e9-87cb-95446d73c479 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:47.291900 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-180c7d34-33b0-4505-9855-739b89aa4c2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:47.292101 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8a7d44bf-18eb-42e9-87cb-95446d73c479 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:47.292387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8a7d44bf-18eb-42e9-87cb-95446d73c479 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:47.293285 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8a7d44bf-18eb-42e9-87cb-95446d73c479 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:47.294218 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8a7d44bf-18eb-42e9-87cb-95446d73c479 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:47.302020 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-180c7d34-33b0-4505-9855-739b89aa4c2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1259 microversion: 2.1 time: 0.173963 Jun 16 16:21:47.302612 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 477/961] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:47 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:47.439468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8a7d44bf-18eb-42e9-87cb-95446d73c479 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:47.447546 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8a7d44bf-18eb-42e9-87cb-95446d73c479 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1267 microversion: 2.1 time: 0.168127 Jun 16 16:21:47.448127 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 485/962] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:47 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:21:48.326938 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9d6bb382-b1f7-4a5d-a622-8f67ae117d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:48.327545 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9d6bb382-b1f7-4a5d-a622-8f67ae117d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:48.334276 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9d6bb382-b1f7-4a5d-a622-8f67ae117d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:48.334723 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9d6bb382-b1f7-4a5d-a622-8f67ae117d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:48.335484 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9d6bb382-b1f7-4a5d-a622-8f67ae117d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:48.335919 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9d6bb382-b1f7-4a5d-a622-8f67ae117d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:48.464698 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8f4a5bb2-ab5a-402a-bc13-22e4a33595ce tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:48.465444 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8f4a5bb2-ab5a-402a-bc13-22e4a33595ce tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:48.471268 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-9d6bb382-b1f7-4a5d-a622-8f67ae117d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:48.472461 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f4a5bb2-ab5a-402a-bc13-22e4a33595ce tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:48.472920 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f4a5bb2-ab5a-402a-bc13-22e4a33595ce tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:48.473710 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f4a5bb2-ab5a-402a-bc13-22e4a33595ce tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:48.474182 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8f4a5bb2-ab5a-402a-bc13-22e4a33595ce tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:48.478785 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9d6bb382-b1f7-4a5d-a622-8f67ae117d60 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1443 microversion: 2.1 time: 0.156439 Jun 16 16:21:48.479356 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 478/963] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:48 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:48.494884 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1a581201-09b7-4469-901e-441ef9482b87 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:48.495446 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1a581201-09b7-4469-901e-441ef9482b87 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:48.502070 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1a581201-09b7-4469-901e-441ef9482b87 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:48.502521 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1a581201-09b7-4469-901e-441ef9482b87 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:48.503288 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1a581201-09b7-4469-901e-441ef9482b87 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:48.503760 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1a581201-09b7-4469-901e-441ef9482b87 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:48.616929 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8f4a5bb2-ab5a-402a-bc13-22e4a33595ce tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:48.627747 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8f4a5bb2-ab5a-402a-bc13-22e4a33595ce tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1267 microversion: 2.1 time: 0.166585 Jun 16 16:21:48.628517 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 486/964] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:48 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:48.655682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1a581201-09b7-4469-901e-441ef9482b87 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:48.663210 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1a581201-09b7-4469-901e-441ef9482b87 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1443 microversion: 2.1 time: 0.172133 Jun 16 16:21:48.663769 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 479/965] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:48 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1443 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:21:49.645875 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-200c7d64-4bfb-4099-96b5-3b8cc0153424 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:49.646715 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-200c7d64-4bfb-4099-96b5-3b8cc0153424 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:49.655520 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-200c7d64-4bfb-4099-96b5-3b8cc0153424 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:49.656119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-200c7d64-4bfb-4099-96b5-3b8cc0153424 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:49.656914 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-200c7d64-4bfb-4099-96b5-3b8cc0153424 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:49.657360 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-200c7d64-4bfb-4099-96b5-3b8cc0153424 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:49.886820 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:49.908411 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=6 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:50.010415 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-200c7d64-4bfb-4099-96b5-3b8cc0153424 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:50.025050 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-200c7d64-4bfb-4099-96b5-3b8cc0153424 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1267 microversion: 2.1 time: 0.384053 Jun 16 16:21:50.025695 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 487/966] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:49 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1267 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:51.042670 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-eab3fb58-aab0-406b-89ad-24f13dd238a0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:51.043290 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-eab3fb58-aab0-406b-89ad-24f13dd238a0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:51.047037 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=2 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:51.052720 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eab3fb58-aab0-406b-89ad-24f13dd238a0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:51.053164 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eab3fb58-aab0-406b-89ad-24f13dd238a0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:51.053983 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eab3fb58-aab0-406b-89ad-24f13dd238a0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:51.054387 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eab3fb58-aab0-406b-89ad-24f13dd238a0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:51.201076 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-eab3fb58-aab0-406b-89ad-24f13dd238a0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:51.210600 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-eab3fb58-aab0-406b-89ad-24f13dd238a0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1267 microversion: 2.1 time: 0.171757 Jun 16 16:21:51.211206 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 480/967] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:51 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:51.380894 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-adc96f42-5c03-44f7-9f16-a539efd5a9ad req-dd396b07-73d5-4cf3-b7ca-0b47b3dd8b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3edfd3e1-fd3e-4455-a860-d55a2f67ef3d", "tag": "d9220eec-1f6d-431f-9e5e-4374035faf5f"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:51.390427 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-adc96f42-5c03-44f7-9f16-a539efd5a9ad req-dd396b07-73d5-4cf3-b7ca-0b47b3dd8b29 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:51.390784 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-adc96f42-5c03-44f7-9f16-a539efd5a9ad req-dd396b07-73d5-4cf3-b7ca-0b47b3dd8b29 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:51.402588 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-adc96f42-5c03-44f7-9f16-a539efd5a9ad req-dd396b07-73d5-4cf3-b7ca-0b47b3dd8b29 service nova] Creating event network-changed:d9220eec-1f6d-431f-9e5e-4374035faf5f for instance 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d on hv-cinder-83716 Jun 16 16:21:51.408846 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-adc96f42-5c03-44f7-9f16-a539efd5a9ad req-dd396b07-73d5-4cf3-b7ca-0b47b3dd8b29 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031546 Jun 16 16:21:51.409670 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 488/968] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:52.235707 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d86f23fa-3853-47b6-844e-7bcb63646772 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:52.236329 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d86f23fa-3853-47b6-844e-7bcb63646772 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:52.243316 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d86f23fa-3853-47b6-844e-7bcb63646772 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:52.243765 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d86f23fa-3853-47b6-844e-7bcb63646772 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:52.244535 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d86f23fa-3853-47b6-844e-7bcb63646772 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:52.244972 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d86f23fa-3853-47b6-844e-7bcb63646772 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:52.426922 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d86f23fa-3853-47b6-844e-7bcb63646772 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:52.435236 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d86f23fa-3853-47b6-844e-7bcb63646772 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1267 microversion: 2.1 time: 0.206188 Jun 16 16:21:52.435897 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 481/969] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:52 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:53.453028 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-941040bd-6926-420a-883a-7cfdc666933b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:53.453846 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-941040bd-6926-420a-883a-7cfdc666933b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:53.460905 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-941040bd-6926-420a-883a-7cfdc666933b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:53.461362 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-941040bd-6926-420a-883a-7cfdc666933b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:53.462213 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-941040bd-6926-420a-883a-7cfdc666933b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:53.462658 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-941040bd-6926-420a-883a-7cfdc666933b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:53.618903 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-941040bd-6926-420a-883a-7cfdc666933b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:53.628216 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-941040bd-6926-420a-883a-7cfdc666933b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1267 microversion: 2.1 time: 0.179729 Jun 16 16:21:53.628799 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 489/970] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:53 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:54.645363 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f181e4ad-e252-4117-bdaa-d149d75bf258 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:54.645980 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f181e4ad-e252-4117-bdaa-d149d75bf258 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:54.652896 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f181e4ad-e252-4117-bdaa-d149d75bf258 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:54.653375 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f181e4ad-e252-4117-bdaa-d149d75bf258 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:54.654193 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f181e4ad-e252-4117-bdaa-d149d75bf258 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:54.654665 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f181e4ad-e252-4117-bdaa-d149d75bf258 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:54.815648 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f181e4ad-e252-4117-bdaa-d149d75bf258 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:54.823773 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f181e4ad-e252-4117-bdaa-d149d75bf258 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1267 microversion: 2.1 time: 0.182277 Jun 16 16:21:54.824348 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 482/971] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:54 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:55.202381 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-e64c4a68-8c70-46ed-9977-bd085b092ca8 req-cc5652c3-dcaa-4fae-98b7-19fe39c56ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe449def-0ec0-4555-96d0-af4550c361cf", "name": "network-vif-plugged", "status": "completed", "tag": "ade79578-a8ae-4117-8223-b656f9d6481b"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:55.211990 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-e64c4a68-8c70-46ed-9977-bd085b092ca8 req-cc5652c3-dcaa-4fae-98b7-19fe39c56ae1 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:55.212441 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-e64c4a68-8c70-46ed-9977-bd085b092ca8 req-cc5652c3-dcaa-4fae-98b7-19fe39c56ae1 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:55.226491 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-e64c4a68-8c70-46ed-9977-bd085b092ca8 req-cc5652c3-dcaa-4fae-98b7-19fe39c56ae1 service nova] Creating event network-vif-plugged:ade79578-a8ae-4117-8223-b656f9d6481b for instance fe449def-0ec0-4555-96d0-af4550c361cf on hv-cinder-83716 Jun 16 16:21:55.233768 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-e64c4a68-8c70-46ed-9977-bd085b092ca8 req-cc5652c3-dcaa-4fae-98b7-19fe39c56ae1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036913 Jun 16 16:21:55.234833 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 490/972] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:55.843477 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b660c889-ec8c-47e9-8831-4dad8da851cd tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:55.844090 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b660c889-ec8c-47e9-8831-4dad8da851cd tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:55.851556 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b660c889-ec8c-47e9-8831-4dad8da851cd tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:55.852010 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b660c889-ec8c-47e9-8831-4dad8da851cd tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:55.852785 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b660c889-ec8c-47e9-8831-4dad8da851cd tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:55.853223 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b660c889-ec8c-47e9-8831-4dad8da851cd tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:56.019691 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b660c889-ec8c-47e9-8831-4dad8da851cd tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:56.027847 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b660c889-ec8c-47e9-8831-4dad8da851cd tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1267 microversion: 2.1 time: 0.189403 Jun 16 16:21:56.028856 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 483/973] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:55 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:57.051029 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8d0d3364-680c-41aa-9c82-1b2dc133b190 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:57.051913 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8d0d3364-680c-41aa-9c82-1b2dc133b190 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:57.062417 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8d0d3364-680c-41aa-9c82-1b2dc133b190 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:57.063170 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8d0d3364-680c-41aa-9c82-1b2dc133b190 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:57.064510 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8d0d3364-680c-41aa-9c82-1b2dc133b190 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:57.065265 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8d0d3364-680c-41aa-9c82-1b2dc133b190 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:57.273452 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8d0d3364-680c-41aa-9c82-1b2dc133b190 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:57.283822 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8d0d3364-680c-41aa-9c82-1b2dc133b190 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1267 microversion: 2.1 time: 0.241786 Jun 16 16:21:57.284432 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 491/974] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:57 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:58.307732 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bebd5cd7-5ac9-4cbd-b08d-6e5eab853500 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:58.308715 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bebd5cd7-5ac9-4cbd-b08d-6e5eab853500 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:58.312634 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=64 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:58.322367 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bebd5cd7-5ac9-4cbd-b08d-6e5eab853500 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:58.322818 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bebd5cd7-5ac9-4cbd-b08d-6e5eab853500 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:58.323585 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bebd5cd7-5ac9-4cbd-b08d-6e5eab853500 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:58.324015 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bebd5cd7-5ac9-4cbd-b08d-6e5eab853500 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:58.478193 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bebd5cd7-5ac9-4cbd-b08d-6e5eab853500 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:58.486778 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bebd5cd7-5ac9-4cbd-b08d-6e5eab853500 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1453 microversion: 2.1 time: 0.183282 Jun 16 16:21:58.487594 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 484/975] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:58 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1453 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:58.503428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fba77413-0967-4cde-b9c4-4b5ec60c10b2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:58.504221 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-fba77413-0967-4cde-b9c4-4b5ec60c10b2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:58.506492 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:58.513050 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fba77413-0967-4cde-b9c4-4b5ec60c10b2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:58.513498 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fba77413-0967-4cde-b9c4-4b5ec60c10b2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:58.514314 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fba77413-0967-4cde-b9c4-4b5ec60c10b2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:58.514753 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fba77413-0967-4cde-b9c4-4b5ec60c10b2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:58.692381 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fba77413-0967-4cde-b9c4-4b5ec60c10b2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:58.700890 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fba77413-0967-4cde-b9c4-4b5ec60c10b2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1453 microversion: 2.1 time: 0.201198 Jun 16 16:21:58.701481 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 492/976] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:58 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1453 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:22:00.721665 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-a3c98261-1675-4b95-b3a7-b39b15b558ec req-9fd070ae-23c4-4de2-982d-c21355ea7e3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe449def-0ec0-4555-96d0-af4550c361cf", "tag": "ade79578-a8ae-4117-8223-b656f9d6481b"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:00.736697 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-a3c98261-1675-4b95-b3a7-b39b15b558ec req-9fd070ae-23c4-4de2-982d-c21355ea7e3b service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:00.737313 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-a3c98261-1675-4b95-b3a7-b39b15b558ec req-9fd070ae-23c4-4de2-982d-c21355ea7e3b service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:00.754090 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-a3c98261-1675-4b95-b3a7-b39b15b558ec req-9fd070ae-23c4-4de2-982d-c21355ea7e3b service nova] Creating event network-changed:ade79578-a8ae-4117-8223-b656f9d6481b for instance fe449def-0ec0-4555-96d0-af4550c361cf on hv-cinder-83716 Jun 16 16:22:00.762701 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-a3c98261-1675-4b95-b3a7-b39b15b558ec req-9fd070ae-23c4-4de2-982d-c21355ea7e3b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046420 Jun 16 16:22:00.763705 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 485/977] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:22:04.917479 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:22:04.919297 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Thu Jun 16 16:22:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:22:27.508143 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4d1ef6af-677e-465e-9969-976651646652 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:27.508882 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4d1ef6af-677e-465e-9969-976651646652 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:27.511682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:27.512558 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=79 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:27.519499 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4d1ef6af-677e-465e-9969-976651646652 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:27.520055 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4d1ef6af-677e-465e-9969-976651646652 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:27.520738 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4d1ef6af-677e-465e-9969-976651646652 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:27.521199 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4d1ef6af-677e-465e-9969-976651646652 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:27.553467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4d1ef6af-677e-465e-9969-976651646652 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/os-volume_attachments/7786994e-da0f-4109-9902-51048ab24c94" status: 200 len: 194 microversion: 2.20 time: 0.050725 Jun 16 16:22:27.554095 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 493/978] 10.222.0.17 () {60 vars in 1453 bytes} [Thu Jun 16 16:22:27 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/os-volume_attachments/7786994e-da0f-4109-9902-51048ab24c94 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:22:27.642127 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-59b36707-f72d-4af4-a22c-022ad79f5049 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:27.643040 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-59b36707-f72d-4af4-a22c-022ad79f5049 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:27.645670 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=3 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:27.646355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=69 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:27.654474 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59b36707-f72d-4af4-a22c-022ad79f5049 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:27.655026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59b36707-f72d-4af4-a22c-022ad79f5049 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:27.655928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59b36707-f72d-4af4-a22c-022ad79f5049 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:27.656490 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-59b36707-f72d-4af4-a22c-022ad79f5049 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:27.748316 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-59b36707-f72d-4af4-a22c-022ad79f5049 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lazy-loading 'services' on Instance uuid 4412fc83-e558-4531-8295-ee5a4f1ba983 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:22:27.835336 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-59b36707-f72d-4af4-a22c-022ad79f5049 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/os-volume_attachments/7786994e-da0f-4109-9902-51048ab24c94" status: 202 len: 0 microversion: 2.20 time: 0.197485 Jun 16 16:22:27.835934 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 486/979] 10.222.0.17 () {60 vars in 1456 bytes} [Thu Jun 16 16:22:27 2022] DELETE /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/os-volume_attachments/7786994e-da0f-4109-9902-51048ab24c94 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:22:27.844984 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b4638e38-4b72-4159-85e2-08dc8da91707 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:27.846049 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b4638e38-4b72-4159-85e2-08dc8da91707 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:27.852549 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b4638e38-4b72-4159-85e2-08dc8da91707 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:27.853005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b4638e38-4b72-4159-85e2-08dc8da91707 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:27.853800 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b4638e38-4b72-4159-85e2-08dc8da91707 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:27.854266 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b4638e38-4b72-4159-85e2-08dc8da91707 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:27.890538 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b4638e38-4b72-4159-85e2-08dc8da91707 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049856 Jun 16 16:22:27.891381 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 494/980] 10.222.0.17 () {60 vars in 1342 bytes} [Thu Jun 16 16:22:27 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:22:28.910232 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a462a4cd-5214-45d7-b0dc-256b8e246417 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:28.910232 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a462a4cd-5214-45d7-b0dc-256b8e246417 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:28.916804 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a462a4cd-5214-45d7-b0dc-256b8e246417 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:28.917262 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a462a4cd-5214-45d7-b0dc-256b8e246417 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:28.918768 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a462a4cd-5214-45d7-b0dc-256b8e246417 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:28.919214 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a462a4cd-5214-45d7-b0dc-256b8e246417 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:28.957804 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a462a4cd-5214-45d7-b0dc-256b8e246417 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053905 Jun 16 16:22:28.958476 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 487/981] 10.222.0.17 () {60 vars in 1342 bytes} [Thu Jun 16 16:22:28 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:22:29.034070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-61326860-c38a-4361-a94d-481a1ae2c37e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:29.034898 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-61326860-c38a-4361-a94d-481a1ae2c37e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:29.044906 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61326860-c38a-4361-a94d-481a1ae2c37e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:29.045359 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61326860-c38a-4361-a94d-481a1ae2c37e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:29.046180 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61326860-c38a-4361-a94d-481a1ae2c37e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:29.046619 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61326860-c38a-4361-a94d-481a1ae2c37e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:29.075723 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-61326860-c38a-4361-a94d-481a1ae2c37e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Going to try to terminate instance {{(pid=117756) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:22:29.166227 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-61326860-c38a-4361-a94d-481a1ae2c37e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 204 len: 0 microversion: 2.20 time: 0.139530 Jun 16 16:22:29.166935 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 495/982] 10.222.0.17 () {60 vars in 1279 bytes} [Thu Jun 16 16:22:29 2022] DELETE /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 16:22:29.177597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b90c63d5-ff1a-4619-ae5b-9eeaab9cd22e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:29.178809 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b90c63d5-ff1a-4619-ae5b-9eeaab9cd22e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:29.186196 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b90c63d5-ff1a-4619-ae5b-9eeaab9cd22e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:29.186661 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b90c63d5-ff1a-4619-ae5b-9eeaab9cd22e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:29.187433 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b90c63d5-ff1a-4619-ae5b-9eeaab9cd22e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:29.187867 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b90c63d5-ff1a-4619-ae5b-9eeaab9cd22e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:29.337537 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b90c63d5-ff1a-4619-ae5b-9eeaab9cd22e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:29.346960 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b90c63d5-ff1a-4619-ae5b-9eeaab9cd22e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:29.348499 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b90c63d5-ff1a-4619-ae5b-9eeaab9cd22e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:29.349664 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b90c63d5-ff1a-4619-ae5b-9eeaab9cd22e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.176249 Jun 16 16:22:29.350256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 488/983] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:29 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:30.371275 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-2a557f13-0e50-4abc-86e9-14edadc2888f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:30.372445 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2a557f13-0e50-4abc-86e9-14edadc2888f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:30.379067 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2a557f13-0e50-4abc-86e9-14edadc2888f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:30.379519 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2a557f13-0e50-4abc-86e9-14edadc2888f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:30.380307 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2a557f13-0e50-4abc-86e9-14edadc2888f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:30.380801 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2a557f13-0e50-4abc-86e9-14edadc2888f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:30.543904 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-2a557f13-0e50-4abc-86e9-14edadc2888f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:30.553109 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-2a557f13-0e50-4abc-86e9-14edadc2888f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:30.554715 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-2a557f13-0e50-4abc-86e9-14edadc2888f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:30.555970 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-2a557f13-0e50-4abc-86e9-14edadc2888f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.189741 Jun 16 16:22:30.556568 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 496/984] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:30 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:31.576545 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-4610bc7b-839e-481f-9d59-efa950f7bee1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:31.578002 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-4610bc7b-839e-481f-9d59-efa950f7bee1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:31.584328 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4610bc7b-839e-481f-9d59-efa950f7bee1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:31.584772 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4610bc7b-839e-481f-9d59-efa950f7bee1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:31.585545 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4610bc7b-839e-481f-9d59-efa950f7bee1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:31.586015 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-4610bc7b-839e-481f-9d59-efa950f7bee1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:31.754930 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4610bc7b-839e-481f-9d59-efa950f7bee1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:31.765547 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4610bc7b-839e-481f-9d59-efa950f7bee1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:31.767587 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-4610bc7b-839e-481f-9d59-efa950f7bee1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:31.769094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-4610bc7b-839e-481f-9d59-efa950f7bee1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1722 microversion: 2.20 time: 0.197306 Jun 16 16:22:31.769668 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 489/985] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:31 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:22:32.547697 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-0efaaaec-ade9-47c2-889d-c9bb869d5490 req-f7b686ee-3026-49f5-a15e-be7f7cefdd9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4412fc83-e558-4531-8295-ee5a4f1ba983", "name": "network-vif-deleted", "tag": "1f148a28-fe89-4254-bdba-5773896f6c82"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:32.568862 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-0efaaaec-ade9-47c2-889d-c9bb869d5490 req-f7b686ee-3026-49f5-a15e-be7f7cefdd9a service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:32.569310 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-0efaaaec-ade9-47c2-889d-c9bb869d5490 req-f7b686ee-3026-49f5-a15e-be7f7cefdd9a service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:32.585127 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-0efaaaec-ade9-47c2-889d-c9bb869d5490 req-f7b686ee-3026-49f5-a15e-be7f7cefdd9a service nova] Creating event network-vif-deleted:1f148a28-fe89-4254-bdba-5773896f6c82 for instance 4412fc83-e558-4531-8295-ee5a4f1ba983 on hv-cinder-83716 Jun 16 16:22:32.590901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-0efaaaec-ade9-47c2-889d-c9bb869d5490 req-f7b686ee-3026-49f5-a15e-be7f7cefdd9a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047762 Jun 16 16:22:32.591521 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 497/986] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:22:32.796054 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1c48adf5-340e-4846-b264-149f3fa86717 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:32.797503 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1c48adf5-340e-4846-b264-149f3fa86717 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:32.805345 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c48adf5-340e-4846-b264-149f3fa86717 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:32.806484 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c48adf5-340e-4846-b264-149f3fa86717 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:32.807665 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c48adf5-340e-4846-b264-149f3fa86717 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:32.809272 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c48adf5-340e-4846-b264-149f3fa86717 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:32.851399 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c48adf5-340e-4846-b264-149f3fa86717 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:32.852020 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1c48adf5-340e-4846-b264-149f3fa86717 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:32.852411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-1c48adf5-340e-4846-b264-149f3fa86717 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lazy-loading 'fault' on Instance uuid 4412fc83-e558-4531-8295-ee5a4f1ba983 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:22:32.933680 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1c48adf5-340e-4846-b264-149f3fa86717 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:32.946117 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1c48adf5-340e-4846-b264-149f3fa86717 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:32.947694 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1c48adf5-340e-4846-b264-149f3fa86717 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:32.949085 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1c48adf5-340e-4846-b264-149f3fa86717 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 200 len: 1371 microversion: 2.20 time: 0.160950 Jun 16 16:22:32.950011 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 490/987] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:32 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:33.970057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-723d76a1-9732-472a-95b2-dd4e430b28ef tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:33.970928 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-723d76a1-9732-472a-95b2-dd4e430b28ef tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:33.979135 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-723d76a1-9732-472a-95b2-dd4e430b28ef tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:33.979600 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-723d76a1-9732-472a-95b2-dd4e430b28ef tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:33.980964 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-723d76a1-9732-472a-95b2-dd4e430b28ef tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:33.981623 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-723d76a1-9732-472a-95b2-dd4e430b28ef tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:33.996206 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-723d76a1-9732-472a-95b2-dd4e430b28ef tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] HTTP exception thrown: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-723d76a1-9732-472a-95b2-dd4e430b28ef tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Request method failure captured: Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 HTTP/1.1 Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1gS2l6U9rLTip3WT1qkw2xr9sX4nprulYxbTHgb46o4FZl_eahvvFPWGGFsRb4hM3vMRMYwBcrwNDFyYre9SbIYIYLVFuKuP_S6EOcuOp_alskU_kopoH0jE2YK9HxugtdU7nWRZmrJK9s6l5CvMEJhQeS_FfLuXX2wuo0Zux0sxaw Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 5411e6d1c7a94aeeaaa8a0a30fb4887b Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:22:33.997979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:22:34.000594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}] Jun 16 16:22:34.000594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:22:34.000594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 5411e6d1c7a94aeeaaa8a0a30fb4887b Jun 16 16:22:34.000594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:22:34.000594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-AttachVolumeShelveTestJSON-2130906217-project Jun 16 16:22:34.000594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:22:34.000594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:22:34.000594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 2b32b74cc1e44ce5a7e687e3c04e8099 Jun 16 16:22:34.000594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2130906217-project Jun 16 16:22:34.000594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:22:34.000594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. Jun 16 16:22:34.000594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': '4412fc83-e558-4531-8295-ee5a4f1ba983'} Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:22:34.002174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. Jun 16 16:22:34.004864 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:22:34.006972 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-723d76a1-9732-472a-95b2-dd4e430b28ef tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Returning 404 to user: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:22:34.006972 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-723d76a1-9732-472a-95b2-dd4e430b28ef tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 404 len: 111 microversion: 2.20 time: 0.034952 Jun 16 16:22:34.006972 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 498/988] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:33 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:22:34.011065 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d350f9e5-e9cb-4d89-b67b-84d07567131e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '.version_select at 0x7f38bb7659d0>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:34.038791 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d350f9e5-e9cb-4d89-b67b-84d07567131e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453247066" status: 204 len: 0 microversion: 2.20 time: 0.031986 Jun 16 16:22:34.039726 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 491/989] 10.222.0.17 () {60 vars in 1261 bytes} [Thu Jun 16 16:22:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453247066 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 16:22:35.085058 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-14f7ad66-993f-4d67-acdd-938e27928112 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Action: 'create', calling method: .version_select at 0x7f38bb58d940>, body: {"keypair": {"name": "tempest-keypair-1221745058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQaFelzX/RVEVgkKO74lQaKCiI4+B2q756dIBO3Loc55Xlq3QnsEuMKnyo9GLbQroWXGXBMt4H/RsEF5hqhdAIxok/1MfHb8vHCWGK0wjAFPMgQUmENIAexnmLNgD4UvQ=="}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:35.101005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-14f7ad66-993f-4d67-acdd-938e27928112 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Getting quotas for project 5411e6d1c7a94aeeaaa8a0a30fb4887b. Resources: {'key_pairs'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:22:35.105771 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.quota [None req-14f7ad66-993f-4d67-acdd-938e27928112 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Getting quotas for user 2b32b74cc1e44ce5a7e687e3c04e8099 and project 5411e6d1c7a94aeeaaa8a0a30fb4887b. Resources: {'key_pairs'} {{(pid=117756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:22:35.132159 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-14f7ad66-993f-4d67-acdd-938e27928112 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051173 Jun 16 16:22:35.132760 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 499/990] 10.222.0.17 () {62 vars in 1199 bytes} [Thu Jun 16 16:22:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 16:22:36.540951 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-208956283", "imageRef": "1c7ea394-df74-4f7e-8e3c-e80907a9fc23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6dc81646-6b2e-4fdc-9873-034ae8e222b6"}], "security_groups": [{"name": "tempest-securitygroup--574971118"}], "key_name": "tempest-keypair-1221745058", "user_data": "}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:36.651479 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] validate_networks() for [('6dc81646-6b2e-4fdc-9873-034ae8e222b6', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:22:37.054350 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:22:37.054496 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:22:37.054892 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:22:37.055296 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:22:37.055703 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:22:37.065864 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:37.066344 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:37.067140 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:37.067571 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:37.085565 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Getting quotas for project 5411e6d1c7a94aeeaaa8a0a30fb4887b. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:22:37.090467 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Getting quotas for user 2b32b74cc1e44ce5a7e687e3c04e8099 and project 5411e6d1c7a94aeeaaa8a0a30fb4887b. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:22:37.101446 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:22:37.103732 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c7ea394-df74-4f7e-8e3c-e80907a9fc23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:22:37.155759 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-35473d30-26fc-45ff-b23b-b4dacae5b4f8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.619525 Jun 16 16:22:37.156410 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 492/991] 10.222.0.17 () {62 vars in 1187 bytes} [Thu Jun 16 16:22:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 16:22:37.168471 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fb5698b0-8609-4e19-b607-184a304fe137 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:37.169184 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-fb5698b0-8609-4e19-b607-184a304fe137 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:37.225452 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fb5698b0-8609-4e19-b607-184a304fe137 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:37.233221 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fb5698b0-8609-4e19-b607-184a304fe137 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:37.234782 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fb5698b0-8609-4e19-b607-184a304fe137 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:37.235922 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fb5698b0-8609-4e19-b607-184a304fe137 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1281 microversion: 2.20 time: 0.072946 Jun 16 16:22:37.238664 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 500/992] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:37 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:38.262004 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-eceaf34f-a6c4-4954-8792-1abdea1b9efb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:38.262593 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-eceaf34f-a6c4-4954-8792-1abdea1b9efb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:38.270274 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eceaf34f-a6c4-4954-8792-1abdea1b9efb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:38.270754 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eceaf34f-a6c4-4954-8792-1abdea1b9efb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:38.271723 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eceaf34f-a6c4-4954-8792-1abdea1b9efb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:38.272130 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-eceaf34f-a6c4-4954-8792-1abdea1b9efb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:38.345277 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-eceaf34f-a6c4-4954-8792-1abdea1b9efb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:38.353662 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-eceaf34f-a6c4-4954-8792-1abdea1b9efb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:38.355261 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-eceaf34f-a6c4-4954-8792-1abdea1b9efb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:38.356635 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-eceaf34f-a6c4-4954-8792-1abdea1b9efb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1339 microversion: 2.20 time: 0.100262 Jun 16 16:22:38.357389 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 493/993] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:38 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:39.384342 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-455759d0-f906-4136-991d-2290882c23e5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:39.385664 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-455759d0-f906-4136-991d-2290882c23e5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:39.396204 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-455759d0-f906-4136-991d-2290882c23e5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:39.396655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-455759d0-f906-4136-991d-2290882c23e5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:39.397440 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-455759d0-f906-4136-991d-2290882c23e5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:39.397876 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-455759d0-f906-4136-991d-2290882c23e5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:39.661290 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-455759d0-f906-4136-991d-2290882c23e5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:39.671160 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-455759d0-f906-4136-991d-2290882c23e5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:39.673075 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-455759d0-f906-4136-991d-2290882c23e5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:39.674840 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-455759d0-f906-4136-991d-2290882c23e5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1406 microversion: 2.20 time: 0.294818 Jun 16 16:22:39.676044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 501/994] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:39 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:39.896055 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-be450882-766d-4032-b8cf-cfff52e8d952 req-33fa91bd-6345-4d7c-9d30-33f78eb272f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c39c574-58f7-40d4-8586-71b6d0e43ad8", "tag": "5ee1def3-312f-411f-9c12-54728972e3ff"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:39.933967 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-be450882-766d-4032-b8cf-cfff52e8d952 req-33fa91bd-6345-4d7c-9d30-33f78eb272f7 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:39.934948 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-be450882-766d-4032-b8cf-cfff52e8d952 req-33fa91bd-6345-4d7c-9d30-33f78eb272f7 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:39.949743 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-be450882-766d-4032-b8cf-cfff52e8d952 req-33fa91bd-6345-4d7c-9d30-33f78eb272f7 service nova] Creating event network-changed:5ee1def3-312f-411f-9c12-54728972e3ff for instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 on hv-cinder-83716 Jun 16 16:22:39.956932 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-be450882-766d-4032-b8cf-cfff52e8d952 req-33fa91bd-6345-4d7c-9d30-33f78eb272f7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065638 Jun 16 16:22:39.957868 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 494/995] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:22:40.693851 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-5599056b-534e-4db7-92e3-e15c2e4db77e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:40.694668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-5599056b-534e-4db7-92e3-e15c2e4db77e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:40.702700 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5599056b-534e-4db7-92e3-e15c2e4db77e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:40.703155 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5599056b-534e-4db7-92e3-e15c2e4db77e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:40.703940 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5599056b-534e-4db7-92e3-e15c2e4db77e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:40.704376 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5599056b-534e-4db7-92e3-e15c2e4db77e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:40.855256 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5599056b-534e-4db7-92e3-e15c2e4db77e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:40.865304 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5599056b-534e-4db7-92e3-e15c2e4db77e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:40.866879 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5599056b-534e-4db7-92e3-e15c2e4db77e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:40.867980 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-5599056b-534e-4db7-92e3-e15c2e4db77e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1406 microversion: 2.20 time: 0.178098 Jun 16 16:22:40.868728 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 502/996] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:40 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:41.888902 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-87f73c31-eaad-4550-8079-19b50ab840e0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:41.889602 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-87f73c31-eaad-4550-8079-19b50ab840e0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:41.896439 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-87f73c31-eaad-4550-8079-19b50ab840e0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:41.896890 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-87f73c31-eaad-4550-8079-19b50ab840e0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:41.897654 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-87f73c31-eaad-4550-8079-19b50ab840e0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:41.898130 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-87f73c31-eaad-4550-8079-19b50ab840e0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:42.036722 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-87f73c31-eaad-4550-8079-19b50ab840e0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:42.045876 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-87f73c31-eaad-4550-8079-19b50ab840e0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:42.047363 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-87f73c31-eaad-4550-8079-19b50ab840e0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:42.048490 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-87f73c31-eaad-4550-8079-19b50ab840e0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1406 microversion: 2.20 time: 0.164612 Jun 16 16:22:42.049040 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 495/997] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:41 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:43.068003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fa8600bd-2d63-4ab7-8ac0-521e9b6d844b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:43.068622 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-fa8600bd-2d63-4ab7-8ac0-521e9b6d844b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:43.075407 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fa8600bd-2d63-4ab7-8ac0-521e9b6d844b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:43.075863 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fa8600bd-2d63-4ab7-8ac0-521e9b6d844b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:43.076641 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fa8600bd-2d63-4ab7-8ac0-521e9b6d844b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:43.077084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-fa8600bd-2d63-4ab7-8ac0-521e9b6d844b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:43.220120 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fa8600bd-2d63-4ab7-8ac0-521e9b6d844b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:43.228613 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fa8600bd-2d63-4ab7-8ac0-521e9b6d844b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:43.230688 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-fa8600bd-2d63-4ab7-8ac0-521e9b6d844b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:43.231818 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fa8600bd-2d63-4ab7-8ac0-521e9b6d844b tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1406 microversion: 2.20 time: 0.168042 Jun 16 16:22:43.232394 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 503/998] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:43 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:44.250228 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-aa1be364-10b5-4076-b92e-c7de5dab4db0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:44.250908 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-aa1be364-10b5-4076-b92e-c7de5dab4db0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:44.257758 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aa1be364-10b5-4076-b92e-c7de5dab4db0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:44.258246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aa1be364-10b5-4076-b92e-c7de5dab4db0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:44.259027 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aa1be364-10b5-4076-b92e-c7de5dab4db0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:44.259468 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-aa1be364-10b5-4076-b92e-c7de5dab4db0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:44.408683 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-aa1be364-10b5-4076-b92e-c7de5dab4db0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:44.417124 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-aa1be364-10b5-4076-b92e-c7de5dab4db0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:44.418661 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-aa1be364-10b5-4076-b92e-c7de5dab4db0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:44.419808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-aa1be364-10b5-4076-b92e-c7de5dab4db0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1406 microversion: 2.20 time: 0.173890 Jun 16 16:22:44.420677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 496/999] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:44 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:45.433751 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-036c2b21-a559-48ff-ba2e-37d351f61f38 req-0e0892bf-b882-4ae8-8734-9ff4be5d7acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c39c574-58f7-40d4-8586-71b6d0e43ad8", "name": "network-vif-plugged", "status": "completed", "tag": "5ee1def3-312f-411f-9c12-54728972e3ff"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:45.440722 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-42d7ec26-8017-43a1-8174-ccc7d8525a8f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:45.441443 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-42d7ec26-8017-43a1-8174-ccc7d8525a8f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:45.443872 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-036c2b21-a559-48ff-ba2e-37d351f61f38 req-0e0892bf-b882-4ae8-8734-9ff4be5d7acd service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:45.444255 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-036c2b21-a559-48ff-ba2e-37d351f61f38 req-0e0892bf-b882-4ae8-8734-9ff4be5d7acd service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:45.451457 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42d7ec26-8017-43a1-8174-ccc7d8525a8f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:45.451931 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42d7ec26-8017-43a1-8174-ccc7d8525a8f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:45.452735 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42d7ec26-8017-43a1-8174-ccc7d8525a8f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:45.453347 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-42d7ec26-8017-43a1-8174-ccc7d8525a8f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:45.456203 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-036c2b21-a559-48ff-ba2e-37d351f61f38 req-0e0892bf-b882-4ae8-8734-9ff4be5d7acd service nova] Creating event network-vif-plugged:5ee1def3-312f-411f-9c12-54728972e3ff for instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 on hv-cinder-83716 Jun 16 16:22:45.461350 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-036c2b21-a559-48ff-ba2e-37d351f61f38 req-0e0892bf-b882-4ae8-8734-9ff4be5d7acd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031340 Jun 16 16:22:45.461995 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 504/1000] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:22:45.621795 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-42d7ec26-8017-43a1-8174-ccc7d8525a8f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:45.632074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-42d7ec26-8017-43a1-8174-ccc7d8525a8f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:45.634358 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-42d7ec26-8017-43a1-8174-ccc7d8525a8f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:45.636241 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-42d7ec26-8017-43a1-8174-ccc7d8525a8f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1406 microversion: 2.20 time: 0.200223 Jun 16 16:22:45.637442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 497/1001] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:45 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:46.658313 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a3d81131-dd39-4141-922c-14722f22bf2f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:46.659122 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a3d81131-dd39-4141-922c-14722f22bf2f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:46.666027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a3d81131-dd39-4141-922c-14722f22bf2f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:46.666492 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a3d81131-dd39-4141-922c-14722f22bf2f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:46.667271 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a3d81131-dd39-4141-922c-14722f22bf2f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:46.667718 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a3d81131-dd39-4141-922c-14722f22bf2f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:46.834822 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a3d81131-dd39-4141-922c-14722f22bf2f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:46.850519 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a3d81131-dd39-4141-922c-14722f22bf2f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:46.852035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a3d81131-dd39-4141-922c-14722f22bf2f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:46.853192 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a3d81131-dd39-4141-922c-14722f22bf2f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1406 microversion: 2.20 time: 0.200177 Jun 16 16:22:46.853753 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 505/1002] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:46 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:22:47.872855 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-25c2e30e-226a-4cde-9eee-97ef2ce6ae69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:47.873484 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-25c2e30e-226a-4cde-9eee-97ef2ce6ae69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:47.875955 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=2 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:47.876733 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=6 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:47.883254 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-25c2e30e-226a-4cde-9eee-97ef2ce6ae69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:47.883721 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-25c2e30e-226a-4cde-9eee-97ef2ce6ae69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:47.884493 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-25c2e30e-226a-4cde-9eee-97ef2ce6ae69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:47.885191 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-25c2e30e-226a-4cde-9eee-97ef2ce6ae69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:48.030678 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-25c2e30e-226a-4cde-9eee-97ef2ce6ae69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:48.038779 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-25c2e30e-226a-4cde-9eee-97ef2ce6ae69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:48.040179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-25c2e30e-226a-4cde-9eee-97ef2ce6ae69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:48.041329 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-25c2e30e-226a-4cde-9eee-97ef2ce6ae69 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1599 microversion: 2.20 time: 0.173314 Jun 16 16:22:48.041886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 498/1003] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:47 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:48.059323 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8777fd48-f0da-490e-a1ed-de072342c3c4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:48.059931 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8777fd48-f0da-490e-a1ed-de072342c3c4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:48.061778 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=6 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:48.067679 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8777fd48-f0da-490e-a1ed-de072342c3c4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:48.068142 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8777fd48-f0da-490e-a1ed-de072342c3c4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:48.068917 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8777fd48-f0da-490e-a1ed-de072342c3c4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:48.069364 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8777fd48-f0da-490e-a1ed-de072342c3c4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:48.155113 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8777fd48-f0da-490e-a1ed-de072342c3c4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100167 Jun 16 16:22:48.155797 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 506/1004] 10.222.0.17 () {60 vars in 1315 bytes} [Thu Jun 16 16:22:48 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:22:49.115368 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-f5cc6091-911b-4faf-8b73-e9c4e0de1117 req-4fd7bef8-9881-4164-8eae-4852c7397869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c39c574-58f7-40d4-8586-71b6d0e43ad8", "tag": "5ee1def3-312f-411f-9c12-54728972e3ff"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:49.126302 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-f5cc6091-911b-4faf-8b73-e9c4e0de1117 req-4fd7bef8-9881-4164-8eae-4852c7397869 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:49.126859 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-f5cc6091-911b-4faf-8b73-e9c4e0de1117 req-4fd7bef8-9881-4164-8eae-4852c7397869 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:49.141668 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-f5cc6091-911b-4faf-8b73-e9c4e0de1117 req-4fd7bef8-9881-4164-8eae-4852c7397869 service nova] Creating event network-changed:5ee1def3-312f-411f-9c12-54728972e3ff for instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 on hv-cinder-83716 Jun 16 16:22:49.150156 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-f5cc6091-911b-4faf-8b73-e9c4e0de1117 req-4fd7bef8-9881-4164-8eae-4852c7397869 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037108 Jun 16 16:22:49.150800 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 499/1005] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:23:25.134677 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:25.135723 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:25.139977 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-5d0e7a85-5f81-433e-8a31-170d15b0fbea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:25.140469 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-5d0e7a85-5f81-433e-8a31-170d15b0fbea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:25.150016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5d0e7a85-5f81-433e-8a31-170d15b0fbea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:25.150502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5d0e7a85-5f81-433e-8a31-170d15b0fbea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:25.151311 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5d0e7a85-5f81-433e-8a31-170d15b0fbea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:25.151763 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5d0e7a85-5f81-433e-8a31-170d15b0fbea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:25.177377 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-5d0e7a85-5f81-433e-8a31-170d15b0fbea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8/ips" status: 200 len: 153 microversion: 2.20 time: 0.044104 Jun 16 16:23:25.177969 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 507/1006] 10.222.0.17 () {60 vars in 1288 bytes} [Thu Jun 16 16:23:25 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8/ips => generated 153 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:23:26.973327 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-602c290a-726a-423c-b457-393e5b874812 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:23:26.973994 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-602c290a-726a-423c-b457-393e5b874812 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:26.976269 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:26.976927 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:26.983557 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-602c290a-726a-423c-b457-393e5b874812 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:26.984010 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-602c290a-726a-423c-b457-393e5b874812 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:26.984780 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-602c290a-726a-423c-b457-393e5b874812 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:26.985212 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-602c290a-726a-423c-b457-393e5b874812 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:27.011341 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-602c290a-726a-423c-b457-393e5b874812 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lazy-loading 'flavor' on Instance uuid 3c39c574-58f7-40d4-8586-71b6d0e43ad8 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:23:27.287796 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-602c290a-726a-423c-b457-393e5b874812 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "POST /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8/action" status: 202 len: 0 microversion: 2.20 time: 0.319755 Jun 16 16:23:27.288615 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 500/1007] 10.222.0.17 () {62 vars in 1318 bytes} [Thu Jun 16 16:23:26 2022] POST /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:23:27.297326 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-802c8c43-aca8-4bcb-b32a-2efd01724895 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:27.298352 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-802c8c43-aca8-4bcb-b32a-2efd01724895 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:27.304688 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-802c8c43-aca8-4bcb-b32a-2efd01724895 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:27.305213 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-802c8c43-aca8-4bcb-b32a-2efd01724895 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:27.306116 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-802c8c43-aca8-4bcb-b32a-2efd01724895 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:27.306644 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-802c8c43-aca8-4bcb-b32a-2efd01724895 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:27.454230 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-802c8c43-aca8-4bcb-b32a-2efd01724895 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:27.462951 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-802c8c43-aca8-4bcb-b32a-2efd01724895 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:27.464618 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-802c8c43-aca8-4bcb-b32a-2efd01724895 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:27.465806 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-802c8c43-aca8-4bcb-b32a-2efd01724895 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1724 microversion: 2.20 time: 0.172980 Jun 16 16:23:27.466401 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 508/1008] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:27 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:28.486723 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c6536477-1c7a-44f8-8f58-1d0dd92876ec tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:28.487435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c6536477-1c7a-44f8-8f58-1d0dd92876ec tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:28.494314 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c6536477-1c7a-44f8-8f58-1d0dd92876ec tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:28.494775 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c6536477-1c7a-44f8-8f58-1d0dd92876ec tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:28.495559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c6536477-1c7a-44f8-8f58-1d0dd92876ec tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:28.495998 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c6536477-1c7a-44f8-8f58-1d0dd92876ec tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:28.646176 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c6536477-1c7a-44f8-8f58-1d0dd92876ec tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:28.655059 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c6536477-1c7a-44f8-8f58-1d0dd92876ec tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:28.656611 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c6536477-1c7a-44f8-8f58-1d0dd92876ec tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:28.657843 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c6536477-1c7a-44f8-8f58-1d0dd92876ec tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1724 microversion: 2.20 time: 0.176477 Jun 16 16:23:28.658448 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 501/1009] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:28 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:29.677156 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-dc550840-97ce-44b5-b591-88ad87a52105 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:29.677751 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-dc550840-97ce-44b5-b591-88ad87a52105 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:29.684314 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dc550840-97ce-44b5-b591-88ad87a52105 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:29.684768 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dc550840-97ce-44b5-b591-88ad87a52105 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:29.685547 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dc550840-97ce-44b5-b591-88ad87a52105 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:29.686017 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dc550840-97ce-44b5-b591-88ad87a52105 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:29.825228 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-dc550840-97ce-44b5-b591-88ad87a52105 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:29.833985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-dc550840-97ce-44b5-b591-88ad87a52105 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:29.835603 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-dc550840-97ce-44b5-b591-88ad87a52105 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:29.836776 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-dc550840-97ce-44b5-b591-88ad87a52105 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1724 microversion: 2.20 time: 0.164264 Jun 16 16:23:29.837339 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 509/1010] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:29 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:30.855928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-df76fef5-53bc-42c1-b11e-e3734291cbf7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:30.856579 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-df76fef5-53bc-42c1-b11e-e3734291cbf7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:30.863548 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df76fef5-53bc-42c1-b11e-e3734291cbf7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:30.863995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df76fef5-53bc-42c1-b11e-e3734291cbf7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:30.864754 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df76fef5-53bc-42c1-b11e-e3734291cbf7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:30.865186 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-df76fef5-53bc-42c1-b11e-e3734291cbf7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:31.004521 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-df76fef5-53bc-42c1-b11e-e3734291cbf7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:31.013171 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-df76fef5-53bc-42c1-b11e-e3734291cbf7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:31.014696 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-df76fef5-53bc-42c1-b11e-e3734291cbf7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:31.015854 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-df76fef5-53bc-42c1-b11e-e3734291cbf7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1724 microversion: 2.20 time: 0.163843 Jun 16 16:23:31.016434 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 502/1011] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:30 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:32.035995 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7f3b9936-2d8b-4012-8be8-f4f837f963a8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:32.036627 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7f3b9936-2d8b-4012-8be8-f4f837f963a8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:32.044585 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7f3b9936-2d8b-4012-8be8-f4f837f963a8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:32.044972 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7f3b9936-2d8b-4012-8be8-f4f837f963a8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:32.045740 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7f3b9936-2d8b-4012-8be8-f4f837f963a8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:32.046277 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7f3b9936-2d8b-4012-8be8-f4f837f963a8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:32.180875 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7f3b9936-2d8b-4012-8be8-f4f837f963a8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:32.189809 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7f3b9936-2d8b-4012-8be8-f4f837f963a8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:32.191300 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7f3b9936-2d8b-4012-8be8-f4f837f963a8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:32.192502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7f3b9936-2d8b-4012-8be8-f4f837f963a8 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1724 microversion: 2.20 time: 0.160674 Jun 16 16:23:32.193057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 510/1012] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:32 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:33.211684 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6e33b707-341e-456d-8a68-6783b9b25f34 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:33.212290 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6e33b707-341e-456d-8a68-6783b9b25f34 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:33.218817 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6e33b707-341e-456d-8a68-6783b9b25f34 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:33.219264 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6e33b707-341e-456d-8a68-6783b9b25f34 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:33.220066 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6e33b707-341e-456d-8a68-6783b9b25f34 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:33.220616 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6e33b707-341e-456d-8a68-6783b9b25f34 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:33.361261 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6e33b707-341e-456d-8a68-6783b9b25f34 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:33.369795 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6e33b707-341e-456d-8a68-6783b9b25f34 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:33.371246 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6e33b707-341e-456d-8a68-6783b9b25f34 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:33.372475 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6e33b707-341e-456d-8a68-6783b9b25f34 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1724 microversion: 2.20 time: 0.164737 Jun 16 16:23:33.373040 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 503/1013] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:33 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:34.397064 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-5a558799-3ba2-4af4-8a26-d4afdb5027e2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:34.397690 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-5a558799-3ba2-4af4-8a26-d4afdb5027e2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:34.404742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5a558799-3ba2-4af4-8a26-d4afdb5027e2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:34.405046 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5a558799-3ba2-4af4-8a26-d4afdb5027e2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:34.405839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5a558799-3ba2-4af4-8a26-d4afdb5027e2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:34.406319 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5a558799-3ba2-4af4-8a26-d4afdb5027e2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:34.552184 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5a558799-3ba2-4af4-8a26-d4afdb5027e2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:34.562688 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5a558799-3ba2-4af4-8a26-d4afdb5027e2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:34.564735 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-5a558799-3ba2-4af4-8a26-d4afdb5027e2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:34.565950 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-5a558799-3ba2-4af4-8a26-d4afdb5027e2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1724 microversion: 2.20 time: 0.172884 Jun 16 16:23:34.566550 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 511/1014] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:34 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:35.584134 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-81df45dc-f7c6-4171-8d13-0021e1217fea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:35.584837 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-81df45dc-f7c6-4171-8d13-0021e1217fea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:35.591738 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-81df45dc-f7c6-4171-8d13-0021e1217fea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:35.592190 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-81df45dc-f7c6-4171-8d13-0021e1217fea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:35.593003 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-81df45dc-f7c6-4171-8d13-0021e1217fea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:35.593451 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-81df45dc-f7c6-4171-8d13-0021e1217fea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:35.775216 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-81df45dc-f7c6-4171-8d13-0021e1217fea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:35.785192 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-81df45dc-f7c6-4171-8d13-0021e1217fea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:35.786690 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-81df45dc-f7c6-4171-8d13-0021e1217fea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:35.788274 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-81df45dc-f7c6-4171-8d13-0021e1217fea tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1724 microversion: 2.20 time: 0.208107 Jun 16 16:23:35.788923 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 504/1015] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:35 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:23:36.817047 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f7314cf9-a365-4788-9ead-627e277e9919 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:36.817654 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f7314cf9-a365-4788-9ead-627e277e9919 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:36.824925 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f7314cf9-a365-4788-9ead-627e277e9919 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:36.825437 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f7314cf9-a365-4788-9ead-627e277e9919 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:36.826249 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f7314cf9-a365-4788-9ead-627e277e9919 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:36.826686 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f7314cf9-a365-4788-9ead-627e277e9919 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:36.965897 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f7314cf9-a365-4788-9ead-627e277e9919 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:36.975244 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f7314cf9-a365-4788-9ead-627e277e9919 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:36.976759 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f7314cf9-a365-4788-9ead-627e277e9919 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:36.977950 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f7314cf9-a365-4788-9ead-627e277e9919 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1724 microversion: 2.20 time: 0.166050 Jun 16 16:23:36.978520 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 512/1016] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:36 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:37.997824 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e75ba36a-5c46-4ed6-b116-f8366a856580 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:37.998495 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e75ba36a-5c46-4ed6-b116-f8366a856580 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:38.005737 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e75ba36a-5c46-4ed6-b116-f8366a856580 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:38.006224 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e75ba36a-5c46-4ed6-b116-f8366a856580 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:38.006994 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e75ba36a-5c46-4ed6-b116-f8366a856580 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:38.007428 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e75ba36a-5c46-4ed6-b116-f8366a856580 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:38.145170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e75ba36a-5c46-4ed6-b116-f8366a856580 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:38.153225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e75ba36a-5c46-4ed6-b116-f8366a856580 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:38.154819 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e75ba36a-5c46-4ed6-b116-f8366a856580 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:38.155971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e75ba36a-5c46-4ed6-b116-f8366a856580 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1724 microversion: 2.20 time: 0.162147 Jun 16 16:23:38.156518 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 505/1017] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:37 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:39.176046 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-25eaae77-80a0-45db-945b-eff8e85277b1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:39.176704 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-25eaae77-80a0-45db-945b-eff8e85277b1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:39.183642 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-25eaae77-80a0-45db-945b-eff8e85277b1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:39.184100 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-25eaae77-80a0-45db-945b-eff8e85277b1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:39.184883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-25eaae77-80a0-45db-945b-eff8e85277b1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:39.185326 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-25eaae77-80a0-45db-945b-eff8e85277b1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:39.329233 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-25eaae77-80a0-45db-945b-eff8e85277b1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:39.338166 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-25eaae77-80a0-45db-945b-eff8e85277b1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:39.339681 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-25eaae77-80a0-45db-945b-eff8e85277b1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:39.340851 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-25eaae77-80a0-45db-945b-eff8e85277b1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1724 microversion: 2.20 time: 0.170010 Jun 16 16:23:39.341410 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 513/1018] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:39 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:40.360236 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-30d15ef2-06a9-4915-b2b1-3e54ec0a4795 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:40.361351 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-30d15ef2-06a9-4915-b2b1-3e54ec0a4795 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:40.368134 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-30d15ef2-06a9-4915-b2b1-3e54ec0a4795 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:40.368583 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-30d15ef2-06a9-4915-b2b1-3e54ec0a4795 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:40.369333 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-30d15ef2-06a9-4915-b2b1-3e54ec0a4795 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:40.369769 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-30d15ef2-06a9-4915-b2b1-3e54ec0a4795 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:40.503320 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-30d15ef2-06a9-4915-b2b1-3e54ec0a4795 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:40.511939 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-30d15ef2-06a9-4915-b2b1-3e54ec0a4795 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:40.513451 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-30d15ef2-06a9-4915-b2b1-3e54ec0a4795 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:40.514661 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-30d15ef2-06a9-4915-b2b1-3e54ec0a4795 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1724 microversion: 2.20 time: 0.158466 Jun 16 16:23:40.515220 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 506/1019] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:40 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:41.534490 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e16dd371-99fa-4a57-864c-e647c44989a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:41.535035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e16dd371-99fa-4a57-864c-e647c44989a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:41.541538 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e16dd371-99fa-4a57-864c-e647c44989a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:41.542017 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e16dd371-99fa-4a57-864c-e647c44989a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:41.542792 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e16dd371-99fa-4a57-864c-e647c44989a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:41.543230 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e16dd371-99fa-4a57-864c-e647c44989a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:41.675000 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e16dd371-99fa-4a57-864c-e647c44989a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:41.682801 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e16dd371-99fa-4a57-864c-e647c44989a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:41.684296 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e16dd371-99fa-4a57-864c-e647c44989a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:41.685443 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e16dd371-99fa-4a57-864c-e647c44989a4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1724 microversion: 2.20 time: 0.155691 Jun 16 16:23:41.686018 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 514/1020] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:41 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:42.704776 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-415e45e7-77be-476d-ac78-1c044f75c68c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:42.705432 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-415e45e7-77be-476d-ac78-1c044f75c68c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:42.712485 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-415e45e7-77be-476d-ac78-1c044f75c68c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:42.712979 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-415e45e7-77be-476d-ac78-1c044f75c68c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:42.713806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-415e45e7-77be-476d-ac78-1c044f75c68c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:42.714412 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-415e45e7-77be-476d-ac78-1c044f75c68c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:42.867567 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-415e45e7-77be-476d-ac78-1c044f75c68c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:42.877740 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-415e45e7-77be-476d-ac78-1c044f75c68c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:42.879324 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-415e45e7-77be-476d-ac78-1c044f75c68c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:42.880545 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-415e45e7-77be-476d-ac78-1c044f75c68c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1745 microversion: 2.20 time: 0.179720 Jun 16 16:23:42.881106 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 507/1021] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:42 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:43.905394 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-42ced8b3-543c-409b-b566-5bf80f5da4d7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:43.906186 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-42ced8b3-543c-409b-b566-5bf80f5da4d7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:43.914569 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-42ced8b3-543c-409b-b566-5bf80f5da4d7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:43.915032 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-42ced8b3-543c-409b-b566-5bf80f5da4d7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:43.915878 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-42ced8b3-543c-409b-b566-5bf80f5da4d7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:43.916531 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-42ced8b3-543c-409b-b566-5bf80f5da4d7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:44.120576 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-42ced8b3-543c-409b-b566-5bf80f5da4d7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:44.137206 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-42ced8b3-543c-409b-b566-5bf80f5da4d7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:44.141031 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-42ced8b3-543c-409b-b566-5bf80f5da4d7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:44.144680 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-42ced8b3-543c-409b-b566-5bf80f5da4d7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1745 microversion: 2.20 time: 0.245920 Jun 16 16:23:44.145621 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 515/1022] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:43 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1745 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:45.164953 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a30b4f26-c9e3-4a2a-aed7-f3b241c4c06c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:45.165571 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a30b4f26-c9e3-4a2a-aed7-f3b241c4c06c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:45.173346 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a30b4f26-c9e3-4a2a-aed7-f3b241c4c06c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:45.173947 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a30b4f26-c9e3-4a2a-aed7-f3b241c4c06c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:45.174831 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a30b4f26-c9e3-4a2a-aed7-f3b241c4c06c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:45.175512 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a30b4f26-c9e3-4a2a-aed7-f3b241c4c06c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:45.381765 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a30b4f26-c9e3-4a2a-aed7-f3b241c4c06c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:45.392453 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a30b4f26-c9e3-4a2a-aed7-f3b241c4c06c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:45.397837 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a30b4f26-c9e3-4a2a-aed7-f3b241c4c06c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:45.399284 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a30b4f26-c9e3-4a2a-aed7-f3b241c4c06c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1740 microversion: 2.20 time: 0.238303 Jun 16 16:23:45.410817 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 508/1023] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:45 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:45.850876 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-1fd6bdc6-f9d1-49f6-8e8a-f818a4b5b7c4 req-fe660ce5-a05f-4c2e-aee2-2e29c2f30ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c39c574-58f7-40d4-8586-71b6d0e43ad8", "name": "network-vif-plugged", "status": "completed", "tag": "5ee1def3-312f-411f-9c12-54728972e3ff"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:23:45.864482 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-1fd6bdc6-f9d1-49f6-8e8a-f818a4b5b7c4 req-fe660ce5-a05f-4c2e-aee2-2e29c2f30ae5 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:45.865476 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-1fd6bdc6-f9d1-49f6-8e8a-f818a4b5b7c4 req-fe660ce5-a05f-4c2e-aee2-2e29c2f30ae5 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:45.886093 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-1fd6bdc6-f9d1-49f6-8e8a-f818a4b5b7c4 req-fe660ce5-a05f-4c2e-aee2-2e29c2f30ae5 service nova] Creating event network-vif-plugged:5ee1def3-312f-411f-9c12-54728972e3ff for instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 on hv-cinder-83716 Jun 16 16:23:45.895022 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-1fd6bdc6-f9d1-49f6-8e8a-f818a4b5b7c4 req-fe660ce5-a05f-4c2e-aee2-2e29c2f30ae5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122488 Jun 16 16:23:45.896734 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 516/1024] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:23:46.419115 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c02bf45d-214b-4bd6-acfe-3da54ef9555a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:46.419737 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c02bf45d-214b-4bd6-acfe-3da54ef9555a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:46.431011 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c02bf45d-214b-4bd6-acfe-3da54ef9555a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:46.431908 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c02bf45d-214b-4bd6-acfe-3da54ef9555a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:46.433596 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c02bf45d-214b-4bd6-acfe-3da54ef9555a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:46.434681 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c02bf45d-214b-4bd6-acfe-3da54ef9555a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:46.576484 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c02bf45d-214b-4bd6-acfe-3da54ef9555a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:46.586831 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c02bf45d-214b-4bd6-acfe-3da54ef9555a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:46.588656 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c02bf45d-214b-4bd6-acfe-3da54ef9555a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:46.590069 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c02bf45d-214b-4bd6-acfe-3da54ef9555a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1740 microversion: 2.20 time: 0.175328 Jun 16 16:23:46.590625 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 509/1025] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:46 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:23:47.611523 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-72e49e8f-4167-4994-9ae0-b97f45805501 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:47.612428 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-72e49e8f-4167-4994-9ae0-b97f45805501 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:47.619071 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-72e49e8f-4167-4994-9ae0-b97f45805501 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:47.619808 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-72e49e8f-4167-4994-9ae0-b97f45805501 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:47.620796 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-72e49e8f-4167-4994-9ae0-b97f45805501 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:47.621471 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-72e49e8f-4167-4994-9ae0-b97f45805501 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:47.783855 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-72e49e8f-4167-4994-9ae0-b97f45805501 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:47.799860 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-72e49e8f-4167-4994-9ae0-b97f45805501 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:47.801788 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-72e49e8f-4167-4994-9ae0-b97f45805501 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:47.803014 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-72e49e8f-4167-4994-9ae0-b97f45805501 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1740 microversion: 2.20 time: 0.197943 Jun 16 16:23:47.805977 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 517/1026] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:47 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:48.822087 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6f86e9b9-9e38-4178-a620-05f46d3670a3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:48.822701 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6f86e9b9-9e38-4178-a620-05f46d3670a3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:48.830043 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6f86e9b9-9e38-4178-a620-05f46d3670a3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:48.830808 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6f86e9b9-9e38-4178-a620-05f46d3670a3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:48.831881 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6f86e9b9-9e38-4178-a620-05f46d3670a3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:48.833173 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6f86e9b9-9e38-4178-a620-05f46d3670a3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:49.008537 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6f86e9b9-9e38-4178-a620-05f46d3670a3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:49.020130 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6f86e9b9-9e38-4178-a620-05f46d3670a3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:49.021643 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6f86e9b9-9e38-4178-a620-05f46d3670a3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:49.022865 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6f86e9b9-9e38-4178-a620-05f46d3670a3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1740 microversion: 2.20 time: 0.204710 Jun 16 16:23:49.023772 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 510/1027] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:48 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:50.046961 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b75129e8-3adf-4895-8a79-2a002bfa64e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:50.048145 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b75129e8-3adf-4895-8a79-2a002bfa64e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:50.055168 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b75129e8-3adf-4895-8a79-2a002bfa64e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:50.055617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b75129e8-3adf-4895-8a79-2a002bfa64e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:50.056377 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b75129e8-3adf-4895-8a79-2a002bfa64e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:50.056813 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b75129e8-3adf-4895-8a79-2a002bfa64e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:50.206693 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b75129e8-3adf-4895-8a79-2a002bfa64e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:50.215623 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b75129e8-3adf-4895-8a79-2a002bfa64e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:50.217206 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b75129e8-3adf-4895-8a79-2a002bfa64e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:50.218548 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b75129e8-3adf-4895-8a79-2a002bfa64e1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1740 microversion: 2.20 time: 0.176127 Jun 16 16:23:50.229645 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 518/1028] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:50 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:51.241998 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a06b17eb-9169-46de-86f4-e814a89612e7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:51.242828 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a06b17eb-9169-46de-86f4-e814a89612e7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:51.258495 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a06b17eb-9169-46de-86f4-e814a89612e7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:51.258495 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a06b17eb-9169-46de-86f4-e814a89612e7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:51.258495 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a06b17eb-9169-46de-86f4-e814a89612e7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:51.261994 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a06b17eb-9169-46de-86f4-e814a89612e7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:51.421203 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a06b17eb-9169-46de-86f4-e814a89612e7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:51.437814 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a06b17eb-9169-46de-86f4-e814a89612e7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:51.441144 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a06b17eb-9169-46de-86f4-e814a89612e7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:51.444081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a06b17eb-9169-46de-86f4-e814a89612e7 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1740 microversion: 2.20 time: 0.211174 Jun 16 16:23:51.459490 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 511/1029] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:51 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:52.230773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a16b4e46-6688-416f-9063-ed0ecd750eac tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:23:52.243456 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a16b4e46-6688-416f-9063-ed0ecd750eac tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:52.247397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a16b4e46-6688-416f-9063-ed0ecd750eac tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:52.247851 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a16b4e46-6688-416f-9063-ed0ecd750eac tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:52.248634 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a16b4e46-6688-416f-9063-ed0ecd750eac tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:52.249068 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a16b4e46-6688-416f-9063-ed0ecd750eac tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:52.283339 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.objects.instance [None req-a16b4e46-6688-416f-9063-ed0ecd750eac tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lazy-loading 'flavor' on Instance uuid 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d {{(pid=117756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:23:52.378190 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a16b4e46-6688-416f-9063-ed0ecd750eac tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "POST /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d/action" status: 202 len: 0 microversion: 2.1 time: 0.150956 Jun 16 16:23:52.382052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 519/1030] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 16:23:52 2022] POST /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:23:52.394248 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0a3a4ab6-7508-4ed9-acdb-b05242b31813 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:52.395708 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0a3a4ab6-7508-4ed9-acdb-b05242b31813 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:52.412937 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0a3a4ab6-7508-4ed9-acdb-b05242b31813 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:52.413395 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0a3a4ab6-7508-4ed9-acdb-b05242b31813 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:52.414666 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0a3a4ab6-7508-4ed9-acdb-b05242b31813 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:52.415116 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0a3a4ab6-7508-4ed9-acdb-b05242b31813 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:52.472111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6f66c4f3-7dd6-4cd5-abac-26035ceb19bc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:52.473258 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6f66c4f3-7dd6-4cd5-abac-26035ceb19bc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:52.484080 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6f66c4f3-7dd6-4cd5-abac-26035ceb19bc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:52.484990 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6f66c4f3-7dd6-4cd5-abac-26035ceb19bc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:52.486113 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6f66c4f3-7dd6-4cd5-abac-26035ceb19bc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:52.487002 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6f66c4f3-7dd6-4cd5-abac-26035ceb19bc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:52.605486 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0a3a4ab6-7508-4ed9-acdb-b05242b31813 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:52.618391 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0a3a4ab6-7508-4ed9-acdb-b05242b31813 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.233980 Jun 16 16:23:52.619326 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 512/1031] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:23:52 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:23:52.685045 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6f66c4f3-7dd6-4cd5-abac-26035ceb19bc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:52.707085 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6f66c4f3-7dd6-4cd5-abac-26035ceb19bc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:52.710553 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6f66c4f3-7dd6-4cd5-abac-26035ceb19bc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:52.712708 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6f66c4f3-7dd6-4cd5-abac-26035ceb19bc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1740 microversion: 2.20 time: 0.246013 Jun 16 16:23:52.714182 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 520/1032] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:52 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:23:53.642453 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ed5b0896-ca55-4bbd-860d-e479bf0539c9 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:53.643234 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ed5b0896-ca55-4bbd-860d-e479bf0539c9 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:53.650241 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed5b0896-ca55-4bbd-860d-e479bf0539c9 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:53.650689 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed5b0896-ca55-4bbd-860d-e479bf0539c9 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:53.651457 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed5b0896-ca55-4bbd-860d-e479bf0539c9 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:53.651894 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ed5b0896-ca55-4bbd-860d-e479bf0539c9 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:53.732812 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7356dd8c-1edc-41a1-a46d-ccda69deab0f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:53.734712 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7356dd8c-1edc-41a1-a46d-ccda69deab0f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:53.743836 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7356dd8c-1edc-41a1-a46d-ccda69deab0f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:53.744826 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7356dd8c-1edc-41a1-a46d-ccda69deab0f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:53.745655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7356dd8c-1edc-41a1-a46d-ccda69deab0f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:53.746293 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7356dd8c-1edc-41a1-a46d-ccda69deab0f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:53.812511 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ed5b0896-ca55-4bbd-860d-e479bf0539c9 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:53.821757 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ed5b0896-ca55-4bbd-860d-e479bf0539c9 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.186023 Jun 16 16:23:53.822424 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 513/1033] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:23:53 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:23:53.941656 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7356dd8c-1edc-41a1-a46d-ccda69deab0f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:53.952926 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7356dd8c-1edc-41a1-a46d-ccda69deab0f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:53.956337 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7356dd8c-1edc-41a1-a46d-ccda69deab0f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:53.957677 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7356dd8c-1edc-41a1-a46d-ccda69deab0f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1740 microversion: 2.20 time: 0.230181 Jun 16 16:23:53.958562 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 521/1034] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:53 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:23:54.840420 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8ae6dd5e-5edd-41a9-bff0-1a810feaa52e tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:54.841044 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8ae6dd5e-5edd-41a9-bff0-1a810feaa52e tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:54.848166 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8ae6dd5e-5edd-41a9-bff0-1a810feaa52e tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:54.848616 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8ae6dd5e-5edd-41a9-bff0-1a810feaa52e tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:54.849401 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8ae6dd5e-5edd-41a9-bff0-1a810feaa52e tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:54.849835 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8ae6dd5e-5edd-41a9-bff0-1a810feaa52e tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:54.870647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:54.981900 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7561ca15-f969-4e82-857c-1539f45b0819 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:54.982717 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7561ca15-f969-4e82-857c-1539f45b0819 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:54.991155 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7561ca15-f969-4e82-857c-1539f45b0819 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:54.991615 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7561ca15-f969-4e82-857c-1539f45b0819 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:54.992388 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7561ca15-f969-4e82-857c-1539f45b0819 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:54.992823 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7561ca15-f969-4e82-857c-1539f45b0819 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:55.013464 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:55.015151 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8ae6dd5e-5edd-41a9-bff0-1a810feaa52e tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:55.028635 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8ae6dd5e-5edd-41a9-bff0-1a810feaa52e tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.192411 Jun 16 16:23:55.029621 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 514/1035] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:23:54 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:23:55.176977 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7561ca15-f969-4e82-857c-1539f45b0819 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:55.186271 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7561ca15-f969-4e82-857c-1539f45b0819 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:55.187998 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7561ca15-f969-4e82-857c-1539f45b0819 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:55.189439 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7561ca15-f969-4e82-857c-1539f45b0819 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1740 microversion: 2.20 time: 0.211763 Jun 16 16:23:55.190028 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 522/1036] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:54 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:56.052365 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0f7c74e3-f2cb-4224-b572-c5e4ec574b19 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:56.053415 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0f7c74e3-f2cb-4224-b572-c5e4ec574b19 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:56.062773 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f7c74e3-f2cb-4224-b572-c5e4ec574b19 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:56.063989 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f7c74e3-f2cb-4224-b572-c5e4ec574b19 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:56.064814 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f7c74e3-f2cb-4224-b572-c5e4ec574b19 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:56.065258 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0f7c74e3-f2cb-4224-b572-c5e4ec574b19 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:56.207750 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-d901d526-6cb9-40ce-af09-c4d89ed1b358 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:56.208570 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-d901d526-6cb9-40ce-af09-c4d89ed1b358 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:56.209171 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0f7c74e3-f2cb-4224-b572-c5e4ec574b19 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:56.210776 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=33 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:56.216866 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d901d526-6cb9-40ce-af09-c4d89ed1b358 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:56.217357 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0f7c74e3-f2cb-4224-b572-c5e4ec574b19 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.169938 Jun 16 16:23:56.217487 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d901d526-6cb9-40ce-af09-c4d89ed1b358 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:56.218112 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 515/1037] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:23:56 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:23:56.218240 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d901d526-6cb9-40ce-af09-c4d89ed1b358 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:56.218602 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-d901d526-6cb9-40ce-af09-c4d89ed1b358 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:56.364478 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d901d526-6cb9-40ce-af09-c4d89ed1b358 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:56.373613 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d901d526-6cb9-40ce-af09-c4d89ed1b358 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:56.375154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-d901d526-6cb9-40ce-af09-c4d89ed1b358 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:56.376994 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-d901d526-6cb9-40ce-af09-c4d89ed1b358 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1722 microversion: 2.20 time: 0.173257 Jun 16 16:23:56.377549 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 523/1038] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:56 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:23:57.236919 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bbaba06e-74ea-492e-bd3d-17256538bc74 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:57.236919 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bbaba06e-74ea-492e-bd3d-17256538bc74 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:57.239342 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=33 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:57.245754 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bbaba06e-74ea-492e-bd3d-17256538bc74 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:57.246354 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bbaba06e-74ea-492e-bd3d-17256538bc74 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:57.247358 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bbaba06e-74ea-492e-bd3d-17256538bc74 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:57.247661 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bbaba06e-74ea-492e-bd3d-17256538bc74 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:57.396474 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ef2de0bd-49c1-4ab6-bfb6-44258914a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:57.397194 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ef2de0bd-49c1-4ab6-bfb6-44258914a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:57.403883 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bbaba06e-74ea-492e-bd3d-17256538bc74 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:57.404420 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ef2de0bd-49c1-4ab6-bfb6-44258914a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:57.404878 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ef2de0bd-49c1-4ab6-bfb6-44258914a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:57.405653 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ef2de0bd-49c1-4ab6-bfb6-44258914a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:57.406128 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ef2de0bd-49c1-4ab6-bfb6-44258914a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:57.413032 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bbaba06e-74ea-492e-bd3d-17256538bc74 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.181472 Jun 16 16:23:57.413677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 516/1039] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:23:57 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:23:57.582141 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ef2de0bd-49c1-4ab6-bfb6-44258914a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:57.590851 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ef2de0bd-49c1-4ab6-bfb6-44258914a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:57.592389 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ef2de0bd-49c1-4ab6-bfb6-44258914a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:57.593585 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ef2de0bd-49c1-4ab6-bfb6-44258914a6b0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1722 microversion: 2.20 time: 0.201095 Jun 16 16:23:57.594279 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 524/1040] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:57 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:23:57.755315 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-0412a9f1-aff0-49d2-9e1f-700075f407d7 req-18b9b8af-5967-4f24-873f-ad386def80ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c39c574-58f7-40d4-8586-71b6d0e43ad8", "name": "network-vif-unplugged", "status": "completed", "tag": "5ee1def3-312f-411f-9c12-54728972e3ff"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:23:57.765175 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-0412a9f1-aff0-49d2-9e1f-700075f407d7 req-18b9b8af-5967-4f24-873f-ad386def80ee service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:57.766500 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-0412a9f1-aff0-49d2-9e1f-700075f407d7 req-18b9b8af-5967-4f24-873f-ad386def80ee service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:57.782906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-0412a9f1-aff0-49d2-9e1f-700075f407d7 req-18b9b8af-5967-4f24-873f-ad386def80ee service nova] Creating event network-vif-unplugged:5ee1def3-312f-411f-9c12-54728972e3ff for instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 on hv-cinder-83716 Jun 16 16:23:57.788782 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-0412a9f1-aff0-49d2-9e1f-700075f407d7 req-18b9b8af-5967-4f24-873f-ad386def80ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037301 Jun 16 16:23:57.789769 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 517/1041] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:23:58.430984 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-04cd1b48-a711-4e6b-8d47-41103582181f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:58.431625 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-04cd1b48-a711-4e6b-8d47-41103582181f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:58.438968 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-04cd1b48-a711-4e6b-8d47-41103582181f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:58.439422 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-04cd1b48-a711-4e6b-8d47-41103582181f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:58.440202 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-04cd1b48-a711-4e6b-8d47-41103582181f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:58.440639 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-04cd1b48-a711-4e6b-8d47-41103582181f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:58.583568 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-04cd1b48-a711-4e6b-8d47-41103582181f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:58.591828 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-04cd1b48-a711-4e6b-8d47-41103582181f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.165153 Jun 16 16:23:58.592441 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 525/1042] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:23:58 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:23:58.615400 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1e0662ff-3d36-4573-add3-cdb86765b14c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:58.618028 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1e0662ff-3d36-4573-add3-cdb86765b14c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:58.622908 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1e0662ff-3d36-4573-add3-cdb86765b14c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:58.623374 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1e0662ff-3d36-4573-add3-cdb86765b14c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:58.624157 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1e0662ff-3d36-4573-add3-cdb86765b14c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:58.624597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1e0662ff-3d36-4573-add3-cdb86765b14c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:58.763954 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1e0662ff-3d36-4573-add3-cdb86765b14c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:58.772105 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1e0662ff-3d36-4573-add3-cdb86765b14c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:58.773587 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1e0662ff-3d36-4573-add3-cdb86765b14c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:58.774799 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1e0662ff-3d36-4573-add3-cdb86765b14c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1665 microversion: 2.20 time: 0.164922 Jun 16 16:23:58.775356 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 518/1043] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:58 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1665 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:23:58.793446 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ecf36a99-648b-4f75-a519-1fc0adce5ca5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40f73dbd-9821-4eba-81d8-b0fb515ad7bb"}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:23:58.794589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ecf36a99-648b-4f75-a519-1fc0adce5ca5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:58.801242 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ecf36a99-648b-4f75-a519-1fc0adce5ca5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:58.801691 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ecf36a99-648b-4f75-a519-1fc0adce5ca5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:58.802486 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ecf36a99-648b-4f75-a519-1fc0adce5ca5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:58.802928 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ecf36a99-648b-4f75-a519-1fc0adce5ca5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:59.100486 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ecf36a99-648b-4f75-a519-1fc0adce5ca5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "POST /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.311001 Jun 16 16:23:59.101097 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 526/1044] 10.222.0.17 () {62 vars in 1363 bytes} [Thu Jun 16 16:23:58 2022] POST /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8/os-volume_attachments => generated 188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:23:59.240099 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c8ceb7ce-f060-4706-9694-6c1bb1f9786a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:59.240499 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c8ceb7ce-f060-4706-9694-6c1bb1f9786a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:59.247432 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c8ceb7ce-f060-4706-9694-6c1bb1f9786a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:59.247887 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c8ceb7ce-f060-4706-9694-6c1bb1f9786a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:59.248670 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c8ceb7ce-f060-4706-9694-6c1bb1f9786a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:59.249113 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c8ceb7ce-f060-4706-9694-6c1bb1f9786a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:59.518877 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c8ceb7ce-f060-4706-9694-6c1bb1f9786a tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8/os-volume_attachments/40f73dbd-9821-4eba-81d8-b0fb515ad7bb" status: 202 len: 0 microversion: 2.20 time: 0.285135 Jun 16 16:23:59.519408 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 519/1045] 10.222.0.17 () {60 vars in 1456 bytes} [Thu Jun 16 16:23:59 2022] DELETE /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8/os-volume_attachments/40f73dbd-9821-4eba-81d8-b0fb515ad7bb => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:23:59.580072 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-5606992f-dfd0-425e-bb45-25625e095764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:23:59.580682 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-5606992f-dfd0-425e-bb45-25625e095764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:59.588951 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5606992f-dfd0-425e-bb45-25625e095764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:59.589403 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5606992f-dfd0-425e-bb45-25625e095764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:59.590233 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5606992f-dfd0-425e-bb45-25625e095764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:59.590704 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-5606992f-dfd0-425e-bb45-25625e095764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:59.609186 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6206689e-9899-4003-99e7-038028074f31 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:59.609842 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6206689e-9899-4003-99e7-038028074f31 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:59.616714 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6206689e-9899-4003-99e7-038028074f31 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:59.617371 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6206689e-9899-4003-99e7-038028074f31 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:59.617937 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6206689e-9899-4003-99e7-038028074f31 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:59.618383 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6206689e-9899-4003-99e7-038028074f31 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:59.697872 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-5606992f-dfd0-425e-bb45-25625e095764 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "POST /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8/action" status: 202 len: 0 microversion: 2.20 time: 0.122637 Jun 16 16:23:59.702083 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 527/1046] 10.222.0.17 () {62 vars in 1318 bytes} [Thu Jun 16 16:23:59 2022] POST /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:23:59.707214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-74c76572-0746-48ce-91ad-10f62982f132 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:59.708062 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-74c76572-0746-48ce-91ad-10f62982f132 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:59.716408 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-74c76572-0746-48ce-91ad-10f62982f132 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:59.716958 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-74c76572-0746-48ce-91ad-10f62982f132 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:59.717855 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-74c76572-0746-48ce-91ad-10f62982f132 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:59.718517 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-74c76572-0746-48ce-91ad-10f62982f132 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:59.821096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6206689e-9899-4003-99e7-038028074f31 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:59.829817 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6206689e-9899-4003-99e7-038028074f31 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.224446 Jun 16 16:23:59.835002 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 520/1047] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:23:59 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:23:59.921004 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-74c76572-0746-48ce-91ad-10f62982f132 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:59.929919 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-74c76572-0746-48ce-91ad-10f62982f132 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:59.931622 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-74c76572-0746-48ce-91ad-10f62982f132 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:59.932955 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-74c76572-0746-48ce-91ad-10f62982f132 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1673 microversion: 2.20 time: 0.229495 Jun 16 16:23:59.933562 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 528/1048] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:59 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1673 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:00.851967 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fa7705cb-0bca-4832-9cbf-880664de85cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:00.852618 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fa7705cb-0bca-4832-9cbf-880664de85cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:00.859498 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa7705cb-0bca-4832-9cbf-880664de85cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:00.861294 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa7705cb-0bca-4832-9cbf-880664de85cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:00.861449 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa7705cb-0bca-4832-9cbf-880664de85cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:00.861888 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa7705cb-0bca-4832-9cbf-880664de85cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:00.952825 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-63932967-005b-41f2-8603-35294393ff54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:00.953807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-63932967-005b-41f2-8603-35294393ff54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:00.961516 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-63932967-005b-41f2-8603-35294393ff54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:00.961996 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-63932967-005b-41f2-8603-35294393ff54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:00.963010 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-63932967-005b-41f2-8603-35294393ff54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:00.963453 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-63932967-005b-41f2-8603-35294393ff54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:01.009100 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fa7705cb-0bca-4832-9cbf-880664de85cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:01.017830 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fa7705cb-0bca-4832-9cbf-880664de85cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.169774 Jun 16 16:24:01.018450 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 521/1049] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:00 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:01.195930 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-63932967-005b-41f2-8603-35294393ff54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:01.204439 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-63932967-005b-41f2-8603-35294393ff54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:01.205989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-63932967-005b-41f2-8603-35294393ff54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:01.207189 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-63932967-005b-41f2-8603-35294393ff54 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1731 microversion: 2.20 time: 0.258256 Jun 16 16:24:01.207744 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 529/1050] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:00 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1731 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:24:02.034346 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5a75c354-1cb6-48d0-a5db-a8503bce2926 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:02.035064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5a75c354-1cb6-48d0-a5db-a8503bce2926 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:02.041777 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a75c354-1cb6-48d0-a5db-a8503bce2926 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:02.042280 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a75c354-1cb6-48d0-a5db-a8503bce2926 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:02.043060 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a75c354-1cb6-48d0-a5db-a8503bce2926 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:02.043493 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a75c354-1cb6-48d0-a5db-a8503bce2926 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:02.231153 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-61653492-3f62-4d81-ae66-ccd38c6e4eae tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:02.233205 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-61653492-3f62-4d81-ae66-ccd38c6e4eae tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:02.260978 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61653492-3f62-4d81-ae66-ccd38c6e4eae tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:02.267467 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61653492-3f62-4d81-ae66-ccd38c6e4eae tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:02.269046 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61653492-3f62-4d81-ae66-ccd38c6e4eae tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:02.269493 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-61653492-3f62-4d81-ae66-ccd38c6e4eae tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:02.290944 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5a75c354-1cb6-48d0-a5db-a8503bce2926 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:02.304933 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5a75c354-1cb6-48d0-a5db-a8503bce2926 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.274342 Jun 16 16:24:02.306476 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 522/1051] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:02 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:02.442751 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-61653492-3f62-4d81-ae66-ccd38c6e4eae tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:02.452486 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-61653492-3f62-4d81-ae66-ccd38c6e4eae tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:02.455687 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-61653492-3f62-4d81-ae66-ccd38c6e4eae tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:02.457468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-61653492-3f62-4d81-ae66-ccd38c6e4eae tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1731 microversion: 2.20 time: 0.233889 Jun 16 16:24:02.464123 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 530/1052] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:02 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:24:03.325194 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bb574184-f951-47ba-8d7d-6aa55b1195aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:03.325961 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bb574184-f951-47ba-8d7d-6aa55b1195aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:03.335561 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb574184-f951-47ba-8d7d-6aa55b1195aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:03.336042 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb574184-f951-47ba-8d7d-6aa55b1195aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:03.336905 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb574184-f951-47ba-8d7d-6aa55b1195aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:03.340563 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bb574184-f951-47ba-8d7d-6aa55b1195aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:03.477950 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b12ffca3-dc32-47c0-8351-c70b9d326752 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:03.480083 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b12ffca3-dc32-47c0-8351-c70b9d326752 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:03.495091 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b12ffca3-dc32-47c0-8351-c70b9d326752 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:03.495550 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b12ffca3-dc32-47c0-8351-c70b9d326752 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:03.496502 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b12ffca3-dc32-47c0-8351-c70b9d326752 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:03.497302 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b12ffca3-dc32-47c0-8351-c70b9d326752 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:03.508531 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bb574184-f951-47ba-8d7d-6aa55b1195aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:03.518101 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bb574184-f951-47ba-8d7d-6aa55b1195aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.196991 Jun 16 16:24:03.518689 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 523/1053] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:03 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:03.687444 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b12ffca3-dc32-47c0-8351-c70b9d326752 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:03.697244 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b12ffca3-dc32-47c0-8351-c70b9d326752 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:03.698811 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b12ffca3-dc32-47c0-8351-c70b9d326752 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:03.700024 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b12ffca3-dc32-47c0-8351-c70b9d326752 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1731 microversion: 2.20 time: 0.227538 Jun 16 16:24:03.702876 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 531/1054] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:03 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1731 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:24:04.536736 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1f4d1792-6285-43ec-a6ed-b4f93b285566 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:04.537370 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1f4d1792-6285-43ec-a6ed-b4f93b285566 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:04.548422 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f4d1792-6285-43ec-a6ed-b4f93b285566 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:04.548871 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f4d1792-6285-43ec-a6ed-b4f93b285566 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:04.549657 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f4d1792-6285-43ec-a6ed-b4f93b285566 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:04.550232 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1f4d1792-6285-43ec-a6ed-b4f93b285566 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:04.721086 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-31d64bdf-5d8c-4e4c-ad51-3d523f0c3abb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:04.721701 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-31d64bdf-5d8c-4e4c-ad51-3d523f0c3abb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:04.722279 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1f4d1792-6285-43ec-a6ed-b4f93b285566 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:04.730357 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1f4d1792-6285-43ec-a6ed-b4f93b285566 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.197435 Jun 16 16:24:04.730951 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 524/1055] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:04 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:04.743972 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-31d64bdf-5d8c-4e4c-ad51-3d523f0c3abb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:04.744424 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-31d64bdf-5d8c-4e4c-ad51-3d523f0c3abb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:04.745214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-31d64bdf-5d8c-4e4c-ad51-3d523f0c3abb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:04.745648 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-31d64bdf-5d8c-4e4c-ad51-3d523f0c3abb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:04.900705 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-31d64bdf-5d8c-4e4c-ad51-3d523f0c3abb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:04.912541 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-31d64bdf-5d8c-4e4c-ad51-3d523f0c3abb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:04.915334 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-31d64bdf-5d8c-4e4c-ad51-3d523f0c3abb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:04.917114 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-31d64bdf-5d8c-4e4c-ad51-3d523f0c3abb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1731 microversion: 2.20 time: 0.201501 Jun 16 16:24:04.917975 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 532/1056] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:04 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:05.749396 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3893d1d2-fd87-4a9a-a053-371de3e4a4f4 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:05.750243 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3893d1d2-fd87-4a9a-a053-371de3e4a4f4 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:05.756562 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3893d1d2-fd87-4a9a-a053-371de3e4a4f4 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:05.757021 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3893d1d2-fd87-4a9a-a053-371de3e4a4f4 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:05.757820 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3893d1d2-fd87-4a9a-a053-371de3e4a4f4 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:05.761616 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3893d1d2-fd87-4a9a-a053-371de3e4a4f4 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:05.925623 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-336e3476-2c89-49e4-abf4-8cfb7e3aa3f9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:05.926785 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-336e3476-2c89-49e4-abf4-8cfb7e3aa3f9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:05.930323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3893d1d2-fd87-4a9a-a053-371de3e4a4f4 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:05.939289 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-336e3476-2c89-49e4-abf4-8cfb7e3aa3f9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:05.940276 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-336e3476-2c89-49e4-abf4-8cfb7e3aa3f9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:05.941466 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-336e3476-2c89-49e4-abf4-8cfb7e3aa3f9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:05.942371 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-336e3476-2c89-49e4-abf4-8cfb7e3aa3f9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:05.943552 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3893d1d2-fd87-4a9a-a053-371de3e4a4f4 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.197743 Jun 16 16:24:05.944557 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 525/1057] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:05 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:05.949653 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ad376c74-050c-4094-b087-a879b5c2cbc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:05.950411 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ad376c74-050c-4094-b087-a879b5c2cbc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:05.959355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad376c74-050c-4094-b087-a879b5c2cbc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:05.959355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad376c74-050c-4094-b087-a879b5c2cbc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:05.960979 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad376c74-050c-4094-b087-a879b5c2cbc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:05.960979 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ad376c74-050c-4094-b087-a879b5c2cbc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:06.001842 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-336e3476-2c89-49e4-abf4-8cfb7e3aa3f9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Going to try to terminate instance {{(pid=117756) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:24:06.081835 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:06.120730 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-336e3476-2c89-49e4-abf4-8cfb7e3aa3f9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 204 len: 0 microversion: 2.1 time: 0.200147 Jun 16 16:24:06.125374 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 533/1058] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:24:05 2022] DELETE /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:24:06.132063 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1002628c-a8f1-4f4c-b07c-a572f5d41b20 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:06.132895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1002628c-a8f1-4f4c-b07c-a572f5d41b20 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:06.139953 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1002628c-a8f1-4f4c-b07c-a572f5d41b20 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:06.140367 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1002628c-a8f1-4f4c-b07c-a572f5d41b20 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:06.141295 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1002628c-a8f1-4f4c-b07c-a572f5d41b20 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:06.141791 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1002628c-a8f1-4f4c-b07c-a572f5d41b20 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:06.143564 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ad376c74-050c-4094-b087-a879b5c2cbc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:06.173898 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ad376c74-050c-4094-b087-a879b5c2cbc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:06.177443 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ad376c74-050c-4094-b087-a879b5c2cbc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:06.179052 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ad376c74-050c-4094-b087-a879b5c2cbc4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1731 microversion: 2.20 time: 0.233301 Jun 16 16:24:06.179782 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 526/1059] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:05 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:06.324784 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1002628c-a8f1-4f4c-b07c-a572f5d41b20 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:06.339730 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1002628c-a8f1-4f4c-b07c-a572f5d41b20 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1578 microversion: 2.1 time: 0.212017 Jun 16 16:24:06.340936 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 534/1060] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:06 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1578 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:06.961484 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-198ce44f-b7e0-48cb-8d2d-2ddcee5fa869 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:06.962097 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-198ce44f-b7e0-48cb-8d2d-2ddcee5fa869 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:06.968741 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-198ce44f-b7e0-48cb-8d2d-2ddcee5fa869 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:06.969741 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-198ce44f-b7e0-48cb-8d2d-2ddcee5fa869 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:06.970551 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-198ce44f-b7e0-48cb-8d2d-2ddcee5fa869 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:06.971000 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-198ce44f-b7e0-48cb-8d2d-2ddcee5fa869 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:07.130456 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-198ce44f-b7e0-48cb-8d2d-2ddcee5fa869 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:07.140133 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-198ce44f-b7e0-48cb-8d2d-2ddcee5fa869 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.182632 Jun 16 16:24:07.140744 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 527/1061] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:06 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:24:07.206182 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-cb1d2587-c8a1-47b8-85ae-72d64a27af07 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:07.207551 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-cb1d2587-c8a1-47b8-85ae-72d64a27af07 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:07.214549 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cb1d2587-c8a1-47b8-85ae-72d64a27af07 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:07.214928 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cb1d2587-c8a1-47b8-85ae-72d64a27af07 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:07.215713 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cb1d2587-c8a1-47b8-85ae-72d64a27af07 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:07.216154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cb1d2587-c8a1-47b8-85ae-72d64a27af07 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:07.365108 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5d5229fc-1a18-4a17-9741-5b2b1fd7e812 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:07.366213 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5d5229fc-1a18-4a17-9741-5b2b1fd7e812 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:07.377344 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d5229fc-1a18-4a17-9741-5b2b1fd7e812 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:07.378135 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d5229fc-1a18-4a17-9741-5b2b1fd7e812 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:07.379636 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d5229fc-1a18-4a17-9741-5b2b1fd7e812 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:07.380598 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5d5229fc-1a18-4a17-9741-5b2b1fd7e812 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:07.458320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-cb1d2587-c8a1-47b8-85ae-72d64a27af07 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:07.469836 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-cb1d2587-c8a1-47b8-85ae-72d64a27af07 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:07.471468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-cb1d2587-c8a1-47b8-85ae-72d64a27af07 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:07.472692 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-cb1d2587-c8a1-47b8-85ae-72d64a27af07 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1731 microversion: 2.20 time: 0.272449 Jun 16 16:24:07.473402 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 535/1062] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:07 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1731 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:07.589996 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5d5229fc-1a18-4a17-9741-5b2b1fd7e812 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:07.598676 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5d5229fc-1a18-4a17-9741-5b2b1fd7e812 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1578 microversion: 2.1 time: 0.241728 Jun 16 16:24:07.606909 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 528/1063] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:07 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1578 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:08.158101 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-02ca038d-8772-419b-8254-02a9a621e9ce tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:08.158765 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-02ca038d-8772-419b-8254-02a9a621e9ce tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:08.165134 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-02ca038d-8772-419b-8254-02a9a621e9ce tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:08.165591 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-02ca038d-8772-419b-8254-02a9a621e9ce tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:08.166381 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-02ca038d-8772-419b-8254-02a9a621e9ce tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:08.166817 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-02ca038d-8772-419b-8254-02a9a621e9ce tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:08.327734 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-02ca038d-8772-419b-8254-02a9a621e9ce tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:08.336354 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-02ca038d-8772-419b-8254-02a9a621e9ce tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.182283 Jun 16 16:24:08.345894 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 536/1064] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:08 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:08.492015 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c94e628b-b5ab-4798-bb9d-9fccc69a19ba tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:08.492602 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-c94e628b-b5ab-4798-bb9d-9fccc69a19ba tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:08.500008 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c94e628b-b5ab-4798-bb9d-9fccc69a19ba tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:08.500550 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c94e628b-b5ab-4798-bb9d-9fccc69a19ba tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:08.501313 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c94e628b-b5ab-4798-bb9d-9fccc69a19ba tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:08.501755 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-c94e628b-b5ab-4798-bb9d-9fccc69a19ba tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:08.523129 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:08.618063 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-dd81173b-bac7-4934-a296-d140572b7db8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:08.618581 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-dd81173b-bac7-4934-a296-d140572b7db8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:08.625700 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dd81173b-bac7-4934-a296-d140572b7db8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:08.626206 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dd81173b-bac7-4934-a296-d140572b7db8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:08.627509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dd81173b-bac7-4934-a296-d140572b7db8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:08.628244 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dd81173b-bac7-4934-a296-d140572b7db8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:08.698922 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c94e628b-b5ab-4798-bb9d-9fccc69a19ba tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:08.708697 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c94e628b-b5ab-4798-bb9d-9fccc69a19ba tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:08.710438 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-c94e628b-b5ab-4798-bb9d-9fccc69a19ba tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:08.715712 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c94e628b-b5ab-4798-bb9d-9fccc69a19ba tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1731 microversion: 2.20 time: 0.223684 Jun 16 16:24:08.716734 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 529/1065] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:08 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1731 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:08.831573 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-dd81173b-bac7-4934-a296-d140572b7db8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:08.839469 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-dd81173b-bac7-4934-a296-d140572b7db8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1578 microversion: 2.1 time: 0.225691 Jun 16 16:24:08.844543 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 537/1066] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:08 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:09.356421 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e31f4979-5f77-45c2-a67c-85fdcadc787d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:09.359187 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e31f4979-5f77-45c2-a67c-85fdcadc787d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:09.364971 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e31f4979-5f77-45c2-a67c-85fdcadc787d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:09.365427 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e31f4979-5f77-45c2-a67c-85fdcadc787d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:09.366243 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e31f4979-5f77-45c2-a67c-85fdcadc787d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:09.366685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e31f4979-5f77-45c2-a67c-85fdcadc787d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:09.566973 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e31f4979-5f77-45c2-a67c-85fdcadc787d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:09.577537 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e31f4979-5f77-45c2-a67c-85fdcadc787d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.226424 Jun 16 16:24:09.579299 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 530/1067] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:09 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:09.734990 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-0e85c672-4f9f-4dc6-b0a7-93892ef6e4f3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:09.735976 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-0e85c672-4f9f-4dc6-b0a7-93892ef6e4f3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:09.743958 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0e85c672-4f9f-4dc6-b0a7-93892ef6e4f3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:09.744410 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0e85c672-4f9f-4dc6-b0a7-93892ef6e4f3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:09.745188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0e85c672-4f9f-4dc6-b0a7-93892ef6e4f3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:09.745632 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0e85c672-4f9f-4dc6-b0a7-93892ef6e4f3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:09.856890 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a4d30410-21b0-44a5-9301-7c7c2dc74661 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:09.857731 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a4d30410-21b0-44a5-9301-7c7c2dc74661 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:09.865636 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a4d30410-21b0-44a5-9301-7c7c2dc74661 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:09.866126 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a4d30410-21b0-44a5-9301-7c7c2dc74661 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:09.866888 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a4d30410-21b0-44a5-9301-7c7c2dc74661 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:09.867320 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a4d30410-21b0-44a5-9301-7c7c2dc74661 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:09.893874 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-0e85c672-4f9f-4dc6-b0a7-93892ef6e4f3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:09.902233 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-0e85c672-4f9f-4dc6-b0a7-93892ef6e4f3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:09.903798 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-0e85c672-4f9f-4dc6-b0a7-93892ef6e4f3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:09.905036 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-0e85c672-4f9f-4dc6-b0a7-93892ef6e4f3 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1731 microversion: 2.20 time: 0.174226 Jun 16 16:24:09.905613 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 538/1068] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:09 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:10.017188 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a4d30410-21b0-44a5-9301-7c7c2dc74661 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:10.024775 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a4d30410-21b0-44a5-9301-7c7c2dc74661 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1578 microversion: 2.1 time: 0.171731 Jun 16 16:24:10.025350 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 531/1069] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:09 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:24:10.596742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ce66fed6-ee20-41ba-b895-4cd487b1afb3 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:10.597347 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ce66fed6-ee20-41ba-b895-4cd487b1afb3 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:10.603794 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ce66fed6-ee20-41ba-b895-4cd487b1afb3 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:10.604252 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ce66fed6-ee20-41ba-b895-4cd487b1afb3 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:10.605095 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ce66fed6-ee20-41ba-b895-4cd487b1afb3 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:10.605592 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ce66fed6-ee20-41ba-b895-4cd487b1afb3 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:10.749446 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ce66fed6-ee20-41ba-b895-4cd487b1afb3 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:10.757947 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ce66fed6-ee20-41ba-b895-4cd487b1afb3 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.165797 Jun 16 16:24:10.758536 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 539/1070] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:10 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:24:10.929216 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-569d6167-63ea-4cd9-9fbd-7263f30d42d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:10.929830 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-569d6167-63ea-4cd9-9fbd-7263f30d42d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:10.936797 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-569d6167-63ea-4cd9-9fbd-7263f30d42d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:10.937252 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-569d6167-63ea-4cd9-9fbd-7263f30d42d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:10.938104 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-569d6167-63ea-4cd9-9fbd-7263f30d42d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:10.938581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-569d6167-63ea-4cd9-9fbd-7263f30d42d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:11.041902 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b522f4fa-6379-4fc5-b975-c80cef8572b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:11.042532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b522f4fa-6379-4fc5-b975-c80cef8572b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:11.049326 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b522f4fa-6379-4fc5-b975-c80cef8572b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:11.049782 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b522f4fa-6379-4fc5-b975-c80cef8572b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:11.050594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b522f4fa-6379-4fc5-b975-c80cef8572b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:11.051090 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b522f4fa-6379-4fc5-b975-c80cef8572b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:11.080452 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-569d6167-63ea-4cd9-9fbd-7263f30d42d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:11.088804 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-569d6167-63ea-4cd9-9fbd-7263f30d42d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:11.090349 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-569d6167-63ea-4cd9-9fbd-7263f30d42d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:11.091538 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-569d6167-63ea-4cd9-9fbd-7263f30d42d9 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1731 microversion: 2.20 time: 0.166517 Jun 16 16:24:11.092097 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 532/1071] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:10 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:11.201265 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b522f4fa-6379-4fc5-b975-c80cef8572b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:11.210146 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b522f4fa-6379-4fc5-b975-c80cef8572b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1578 microversion: 2.1 time: 0.171989 Jun 16 16:24:11.210958 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 540/1072] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:11 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:24:11.776062 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2c0fda51-00f1-4100-a62e-2259cde73535 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:11.776711 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2c0fda51-00f1-4100-a62e-2259cde73535 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:11.783036 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c0fda51-00f1-4100-a62e-2259cde73535 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:11.783491 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c0fda51-00f1-4100-a62e-2259cde73535 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:11.784265 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c0fda51-00f1-4100-a62e-2259cde73535 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:11.784705 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2c0fda51-00f1-4100-a62e-2259cde73535 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:11.934717 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2c0fda51-00f1-4100-a62e-2259cde73535 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:11.943521 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2c0fda51-00f1-4100-a62e-2259cde73535 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.171290 Jun 16 16:24:11.944161 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 533/1073] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:11 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:12.111150 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1172064c-101a-4bf2-bd62-277f3b3f2ee0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:12.111870 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1172064c-101a-4bf2-bd62-277f3b3f2ee0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:12.118724 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1172064c-101a-4bf2-bd62-277f3b3f2ee0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:12.119105 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1172064c-101a-4bf2-bd62-277f3b3f2ee0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:12.119907 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1172064c-101a-4bf2-bd62-277f3b3f2ee0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:12.120327 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1172064c-101a-4bf2-bd62-277f3b3f2ee0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:12.229356 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-96565393-4b4c-413b-b3c8-a29efc808145 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:12.230160 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-96565393-4b4c-413b-b3c8-a29efc808145 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:12.237656 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-96565393-4b4c-413b-b3c8-a29efc808145 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:12.238206 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-96565393-4b4c-413b-b3c8-a29efc808145 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:12.238985 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-96565393-4b4c-413b-b3c8-a29efc808145 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:12.239417 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-96565393-4b4c-413b-b3c8-a29efc808145 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:12.270471 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1172064c-101a-4bf2-bd62-277f3b3f2ee0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:12.279350 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1172064c-101a-4bf2-bd62-277f3b3f2ee0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:12.280910 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-1172064c-101a-4bf2-bd62-277f3b3f2ee0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:12.282834 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1172064c-101a-4bf2-bd62-277f3b3f2ee0 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1731 microversion: 2.20 time: 0.175878 Jun 16 16:24:12.283418 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 541/1074] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:12 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:12.382303 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-96565393-4b4c-413b-b3c8-a29efc808145 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:12.390373 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-96565393-4b4c-413b-b3c8-a29efc808145 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1578 microversion: 2.1 time: 0.165081 Jun 16 16:24:12.392522 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 534/1075] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:12 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:12.962356 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-707d4c3b-640d-441d-b2b8-8de828197109 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:12.963072 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-707d4c3b-640d-441d-b2b8-8de828197109 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:12.969824 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-707d4c3b-640d-441d-b2b8-8de828197109 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:12.970301 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-707d4c3b-640d-441d-b2b8-8de828197109 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:12.971437 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-707d4c3b-640d-441d-b2b8-8de828197109 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:12.971570 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-707d4c3b-640d-441d-b2b8-8de828197109 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:13.297885 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-707d4c3b-640d-441d-b2b8-8de828197109 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:13.301313 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e482e56a-2de8-4a31-9366-18a16ebeb43c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:13.303153 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e482e56a-2de8-4a31-9366-18a16ebeb43c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:13.309495 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e482e56a-2de8-4a31-9366-18a16ebeb43c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:13.310094 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e482e56a-2de8-4a31-9366-18a16ebeb43c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:13.310743 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e482e56a-2de8-4a31-9366-18a16ebeb43c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:13.311180 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e482e56a-2de8-4a31-9366-18a16ebeb43c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:13.311562 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-707d4c3b-640d-441d-b2b8-8de828197109 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.353648 Jun 16 16:24:13.312385 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 542/1076] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:12 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:24:13.407850 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-538cb7e6-a660-4e57-9664-bbb42dac53fb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:13.408633 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-538cb7e6-a660-4e57-9664-bbb42dac53fb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:13.414900 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-538cb7e6-a660-4e57-9664-bbb42dac53fb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:13.415358 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-538cb7e6-a660-4e57-9664-bbb42dac53fb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:13.416137 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-538cb7e6-a660-4e57-9664-bbb42dac53fb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:13.416796 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-538cb7e6-a660-4e57-9664-bbb42dac53fb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:13.462982 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e482e56a-2de8-4a31-9366-18a16ebeb43c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:13.475789 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e482e56a-2de8-4a31-9366-18a16ebeb43c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:13.477621 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-e482e56a-2de8-4a31-9366-18a16ebeb43c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:13.479004 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e482e56a-2de8-4a31-9366-18a16ebeb43c tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1731 microversion: 2.20 time: 0.182371 Jun 16 16:24:13.480291 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 535/1077] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:13 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:24:13.633272 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-538cb7e6-a660-4e57-9664-bbb42dac53fb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:13.644457 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-538cb7e6-a660-4e57-9664-bbb42dac53fb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1578 microversion: 2.1 time: 0.240174 Jun 16 16:24:13.645263 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 543/1078] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:13 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1578 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:24:14.334260 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-471471ce-4dff-4694-a24a-ef349703c772 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:14.334260 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-471471ce-4dff-4694-a24a-ef349703c772 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:14.340823 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-471471ce-4dff-4694-a24a-ef349703c772 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:14.341545 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-471471ce-4dff-4694-a24a-ef349703c772 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:14.342366 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-471471ce-4dff-4694-a24a-ef349703c772 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:14.342896 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-471471ce-4dff-4694-a24a-ef349703c772 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:14.472970 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-bc4e686c-b428-4dd9-b1ac-827c679bc0ac req-6d764868-6a54-4bd7-81e7-edf0869700cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe449def-0ec0-4555-96d0-af4550c361cf", "name": "network-vif-deleted", "tag": "ade79578-a8ae-4117-8223-b656f9d6481b"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:24:14.490390 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-bc4e686c-b428-4dd9-b1ac-827c679bc0ac req-6d764868-6a54-4bd7-81e7-edf0869700cd service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:14.491706 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-bc4e686c-b428-4dd9-b1ac-827c679bc0ac req-6d764868-6a54-4bd7-81e7-edf0869700cd service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:14.520158 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-bc4e686c-b428-4dd9-b1ac-827c679bc0ac req-6d764868-6a54-4bd7-81e7-edf0869700cd service nova] Creating event network-vif-deleted:ade79578-a8ae-4117-8223-b656f9d6481b for instance fe449def-0ec0-4555-96d0-af4550c361cf on hv-cinder-83716 Jun 16 16:24:14.535652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-bc4e686c-b428-4dd9-b1ac-827c679bc0ac req-6d764868-6a54-4bd7-81e7-edf0869700cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147066 Jun 16 16:24:14.542393 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 544/1079] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:24:14.555901 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-3f2b352b-a820-465d-be62-730fb4a779e6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:14.559544 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-3f2b352b-a820-465d-be62-730fb4a779e6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:14.569482 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3f2b352b-a820-465d-be62-730fb4a779e6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:14.570320 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3f2b352b-a820-465d-be62-730fb4a779e6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:14.571612 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3f2b352b-a820-465d-be62-730fb4a779e6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:14.572280 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-3f2b352b-a820-465d-be62-730fb4a779e6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:14.584265 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-471471ce-4dff-4694-a24a-ef349703c772 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:14.600007 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-471471ce-4dff-4694-a24a-ef349703c772 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.273652 Jun 16 16:24:14.600875 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 536/1080] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:14 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:14.663252 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fcfceaec-64c9-46b6-bf24-d7aefdde2eb4 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:14.664091 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fcfceaec-64c9-46b6-bf24-d7aefdde2eb4 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:14.670916 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fcfceaec-64c9-46b6-bf24-d7aefdde2eb4 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:14.671378 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fcfceaec-64c9-46b6-bf24-d7aefdde2eb4 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:14.672970 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fcfceaec-64c9-46b6-bf24-d7aefdde2eb4 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:14.673666 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fcfceaec-64c9-46b6-bf24-d7aefdde2eb4 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:14.750687 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fcfceaec-64c9-46b6-bf24-d7aefdde2eb4 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:14.759526 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fcfceaec-64c9-46b6-bf24-d7aefdde2eb4 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 200 len: 1510 microversion: 2.1 time: 0.100706 Jun 16 16:24:14.761079 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 537/1081] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:14 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 1510 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:24:14.770931 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3f2b352b-a820-465d-be62-730fb4a779e6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:14.785352 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3f2b352b-a820-465d-be62-730fb4a779e6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:14.788552 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-3f2b352b-a820-465d-be62-730fb4a779e6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:14.791012 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-3f2b352b-a820-465d-be62-730fb4a779e6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1731 microversion: 2.20 time: 0.245812 Jun 16 16:24:14.791966 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 545/1082] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:14 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1731 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:15.619792 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-508387d8-3ec0-4e11-b301-a96b1fb008cb tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:15.620743 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-508387d8-3ec0-4e11-b301-a96b1fb008cb tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:15.633957 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-508387d8-3ec0-4e11-b301-a96b1fb008cb tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:15.636893 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-508387d8-3ec0-4e11-b301-a96b1fb008cb tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:15.641559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-508387d8-3ec0-4e11-b301-a96b1fb008cb tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:15.642870 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-508387d8-3ec0-4e11-b301-a96b1fb008cb tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:15.779038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b50bc153-ab6a-4423-a067-93a46f48b7d9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:15.780522 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b50bc153-ab6a-4423-a067-93a46f48b7d9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:15.789713 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b50bc153-ab6a-4423-a067-93a46f48b7d9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:15.790473 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b50bc153-ab6a-4423-a067-93a46f48b7d9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:15.791770 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b50bc153-ab6a-4423-a067-93a46f48b7d9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:15.792681 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b50bc153-ab6a-4423-a067-93a46f48b7d9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:15.809831 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-b50bc153-ab6a-4423-a067-93a46f48b7d9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] HTTP exception thrown: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b50bc153-ab6a-4423-a067-93a46f48b7d9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Request method failure captured: Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf HTTP/1.1 Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1h1oYF_vlA3--mpP6tdYxPGW1XWRwY5NXO9weCY8DVGK7_SCgheaI8GmZLfhKQMSzIztWgvJXd9HZiUYLHL-bS3MS4yaOK38jY44Dhh4M-30UuQKXJsvcB9sY1YUReou2wx_WOeQ45tGoCTuG-xOMhm6WAySBtjZGHUzYslkiLg0ak Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: b77126371c5d44db8ab75fbfca0737af Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-TestVolumeBootPattern-1734897560 Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:24:15.811590 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:24:15.818397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b77126371c5d44db8ab75fbfca0737af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b77126371c5d44db8ab75fbfca0737af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b77126371c5d44db8ab75fbfca0737af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b77126371c5d44db8ab75fbfca0737af"}]}] Jun 16 16:24:15.818397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-TestVolumeBootPattern-1734897560 Jun 16 16:24:15.818397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: b77126371c5d44db8ab75fbfca0737af Jun 16 16:24:15.818397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-TestVolumeBootPattern-1734897560 Jun 16 16:24:15.818397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-TestVolumeBootPattern-1734897560-project Jun 16 16:24:15.818397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:24:15.818397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:24:15.818397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 373d58e9f0e6472dad412ac02bff2b94 Jun 16 16:24:15.818397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-TestVolumeBootPattern-1734897560-project Jun 16 16:24:15.818397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:24:15.818397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. Jun 16 16:24:15.818397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': 'fe449def-0ec0-4555-96d0-af4550c361cf'} Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:24:15.819316 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. Jun 16 16:24:15.820655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:24:15.821865 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b50bc153-ab6a-4423-a067-93a46f48b7d9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Returning 404 to user: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:24:15.821865 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b50bc153-ab6a-4423-a067-93a46f48b7d9 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 404 len: 111 microversion: 2.1 time: 0.038677 Jun 16 16:24:15.823152 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 546/1083] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:15 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:24:15.827272 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-9996d1d4-6aad-4b40-8125-c5c57863a327 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:15.827898 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-9996d1d4-6aad-4b40-8125-c5c57863a327 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:15.836072 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9996d1d4-6aad-4b40-8125-c5c57863a327 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:15.836533 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9996d1d4-6aad-4b40-8125-c5c57863a327 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:15.837326 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9996d1d4-6aad-4b40-8125-c5c57863a327 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:15.837766 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9996d1d4-6aad-4b40-8125-c5c57863a327 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:15.847860 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-508387d8-3ec0-4e11-b301-a96b1fb008cb tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:15.858133 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-508387d8-3ec0-4e11-b301-a96b1fb008cb tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.242249 Jun 16 16:24:15.858491 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 538/1084] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:15 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:15.884869 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1273479433", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1070108778", "security_groups": [{"name": "tempest-secgroup-smoke-1016408516"}], "block_device_mapping_v2": [{"uuid": "8e77c0b4-2a89-4478-a927-b4361ebddc21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8adc531-7e83-47cd-8743-c56fb61916fb"}]}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:24:16.006979 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-9996d1d4-6aad-4b40-8125-c5c57863a327 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:16.020173 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-9996d1d4-6aad-4b40-8125-c5c57863a327 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:16.021938 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-9996d1d4-6aad-4b40-8125-c5c57863a327 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:16.023597 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-9996d1d4-6aad-4b40-8125-c5c57863a327 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1731 microversion: 2.20 time: 0.199975 Jun 16 16:24:16.024167 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 547/1085] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:15 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:16.024670 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] validate_networks() for [('c8adc531-7e83-47cd-8743-c56fb61916fb', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:24:16.037183 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-14f69671-03d9-4d1a-a09b-7be6fe687ed3 req-3f281ff0-4ac8-4829-af20-5bf88213e359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c39c574-58f7-40d4-8586-71b6d0e43ad8", "name": "network-vif-plugged", "status": "completed", "tag": "5ee1def3-312f-411f-9c12-54728972e3ff"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:24:16.056084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-14f69671-03d9-4d1a-a09b-7be6fe687ed3 req-3f281ff0-4ac8-4829-af20-5bf88213e359 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:16.059667 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-14f69671-03d9-4d1a-a09b-7be6fe687ed3 req-3f281ff0-4ac8-4829-af20-5bf88213e359 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:16.073775 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-14f69671-03d9-4d1a-a09b-7be6fe687ed3 req-3f281ff0-4ac8-4829-af20-5bf88213e359 service nova] Creating event network-vif-plugged:5ee1def3-312f-411f-9c12-54728972e3ff for instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 on hv-cinder-83716 Jun 16 16:24:16.079884 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-14f69671-03d9-4d1a-a09b-7be6fe687ed3 req-3f281ff0-4ac8-4829-af20-5bf88213e359 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052832 Jun 16 16:24:16.081050 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 548/1086] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:24:16.521055 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:24:16.521471 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:24:16.521970 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:24:16.522377 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:24:16.522782 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:24:16.532923 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:16.533361 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:16.534185 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:16.534619 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:16.552951 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Getting quotas for project b77126371c5d44db8ab75fbfca0737af. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:24:16.556957 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Getting quotas for user 373d58e9f0e6472dad412ac02bff2b94 and project b77126371c5d44db8ab75fbfca0737af. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:24:16.617658 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:24:16.619809 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e77c0b4-2a89-4478-a927-b4361ebddc21',volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:24:16.765356 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8482b97a-1c8d-4af4-bf93-86478afc1e60 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.884668 Jun 16 16:24:16.767782 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 539/1087] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:24:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:24:16.779753 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-84712579-51c1-4229-8564-7eacbb051355 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:16.780503 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-84712579-51c1-4229-8564-7eacbb051355 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:16.841814 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-84712579-51c1-4229-8564-7eacbb051355 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:16.849727 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-84712579-51c1-4229-8564-7eacbb051355 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1095 microversion: 2.1 time: 0.074666 Jun 16 16:24:16.850356 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 549/1088] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:16 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:16.876631 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-02df8a85-4185-41b7-8050-2afd86d2b57c tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:16.877768 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-02df8a85-4185-41b7-8050-2afd86d2b57c tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:16.884564 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-02df8a85-4185-41b7-8050-2afd86d2b57c tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:16.885081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-02df8a85-4185-41b7-8050-2afd86d2b57c tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:16.886153 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-02df8a85-4185-41b7-8050-2afd86d2b57c tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:16.886600 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-02df8a85-4185-41b7-8050-2afd86d2b57c tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:17.034613 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-02df8a85-4185-41b7-8050-2afd86d2b57c tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:17.043315 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-02df8a85-4185-41b7-8050-2afd86d2b57c tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1509 microversion: 2.1 time: 0.170761 Jun 16 16:24:17.044288 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 540/1089] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:16 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:17.044662 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-0049f678-5c15-4fcd-9f59-3a95fb0afd7f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:17.045512 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-0049f678-5c15-4fcd-9f59-3a95fb0afd7f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:17.052810 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0049f678-5c15-4fcd-9f59-3a95fb0afd7f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:17.053287 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0049f678-5c15-4fcd-9f59-3a95fb0afd7f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:17.054121 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0049f678-5c15-4fcd-9f59-3a95fb0afd7f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:17.054612 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-0049f678-5c15-4fcd-9f59-3a95fb0afd7f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:17.066377 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-035bdb4b-54c2-4c8f-94f7-8fdfb0870a4f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:24:17.067204 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-035bdb4b-54c2-4c8f-94f7-8fdfb0870a4f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:17.075825 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-035bdb4b-54c2-4c8f-94f7-8fdfb0870a4f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:17.075825 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-035bdb4b-54c2-4c8f-94f7-8fdfb0870a4f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:17.076560 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-035bdb4b-54c2-4c8f-94f7-8fdfb0870a4f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:17.076996 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-035bdb4b-54c2-4c8f-94f7-8fdfb0870a4f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:17.178224 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-035bdb4b-54c2-4c8f-94f7-8fdfb0870a4f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "POST /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d/action" status: 202 len: 0 microversion: 2.1 time: 0.120194 Jun 16 16:24:17.179168 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 541/1090] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 16:24:17 2022] POST /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:24:17.188829 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ba4c5888-2f2b-4735-b7c6-3b065ecae010 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:17.189557 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ba4c5888-2f2b-4735-b7c6-3b065ecae010 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:17.197373 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ba4c5888-2f2b-4735-b7c6-3b065ecae010 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:17.197373 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ba4c5888-2f2b-4735-b7c6-3b065ecae010 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:17.198312 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ba4c5888-2f2b-4735-b7c6-3b065ecae010 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:17.199019 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ba4c5888-2f2b-4735-b7c6-3b065ecae010 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:17.233509 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-0049f678-5c15-4fcd-9f59-3a95fb0afd7f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:17.244127 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-0049f678-5c15-4fcd-9f59-3a95fb0afd7f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:17.245974 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-0049f678-5c15-4fcd-9f59-3a95fb0afd7f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:17.247732 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-0049f678-5c15-4fcd-9f59-3a95fb0afd7f tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1731 microversion: 2.20 time: 0.207623 Jun 16 16:24:17.248916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 550/1091] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:17 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:17.429683 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-ba4c5888-2f2b-4735-b7c6-3b065ecae010 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:17.443177 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ba4c5888-2f2b-4735-b7c6-3b065ecae010 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1517 microversion: 2.1 time: 0.259034 Jun 16 16:24:17.445967 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 542/1092] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:17 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1517 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:17.870298 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-60d8e85e-59e6-434f-9e2a-c762b5156d2b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:17.871375 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-60d8e85e-59e6-434f-9e2a-c762b5156d2b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:17.881601 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-60d8e85e-59e6-434f-9e2a-c762b5156d2b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:17.882309 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-60d8e85e-59e6-434f-9e2a-c762b5156d2b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:17.883500 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-60d8e85e-59e6-434f-9e2a-c762b5156d2b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:17.884160 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-60d8e85e-59e6-434f-9e2a-c762b5156d2b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:17.963797 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-60d8e85e-59e6-434f-9e2a-c762b5156d2b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:17.976798 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-60d8e85e-59e6-434f-9e2a-c762b5156d2b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1193 microversion: 2.1 time: 0.112929 Jun 16 16:24:17.977500 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 551/1093] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:17 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1193 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:18.100488 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-61d3ecd1-b85a-46f6-a870-cc69db41ae54 req-674167d4-fe4b-4a9e-bfb8-c5f6aa55d2ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3edfd3e1-fd3e-4455-a860-d55a2f67ef3d", "name": "network-vif-unplugged", "status": "completed", "tag": "d9220eec-1f6d-431f-9e5e-4374035faf5f"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:24:18.111869 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-61d3ecd1-b85a-46f6-a870-cc69db41ae54 req-674167d4-fe4b-4a9e-bfb8-c5f6aa55d2ab service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:18.112573 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-61d3ecd1-b85a-46f6-a870-cc69db41ae54 req-674167d4-fe4b-4a9e-bfb8-c5f6aa55d2ab service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:18.128055 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.compute.server_external_events [req-61d3ecd1-b85a-46f6-a870-cc69db41ae54 req-674167d4-fe4b-4a9e-bfb8-c5f6aa55d2ab service nova] Unable to find a host for instance 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d. Dropping event network-vif-unplugged {{(pid=117755) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 16:24:18.129188 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-61d3ecd1-b85a-46f6-a870-cc69db41ae54 req-674167d4-fe4b-4a9e-bfb8-c5f6aa55d2ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032620 Jun 16 16:24:18.129819 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 543/1094] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 16:24:18.269992 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4ed6bbda-4021-45e7-b6b6-7a1918c5c6f1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:18.270620 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4ed6bbda-4021-45e7-b6b6-7a1918c5c6f1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:18.278132 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4ed6bbda-4021-45e7-b6b6-7a1918c5c6f1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:18.278610 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4ed6bbda-4021-45e7-b6b6-7a1918c5c6f1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:18.279829 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4ed6bbda-4021-45e7-b6b6-7a1918c5c6f1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:18.280568 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4ed6bbda-4021-45e7-b6b6-7a1918c5c6f1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:18.467895 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-bbc6a904-ef62-4213-a69c-c153669c7a40 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:18.469295 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-bbc6a904-ef62-4213-a69c-c153669c7a40 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:18.483763 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bbc6a904-ef62-4213-a69c-c153669c7a40 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:18.486134 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bbc6a904-ef62-4213-a69c-c153669c7a40 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:18.491451 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bbc6a904-ef62-4213-a69c-c153669c7a40 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:18.493138 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-bbc6a904-ef62-4213-a69c-c153669c7a40 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:18.556705 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4ed6bbda-4021-45e7-b6b6-7a1918c5c6f1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:18.572326 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4ed6bbda-4021-45e7-b6b6-7a1918c5c6f1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:18.574204 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4ed6bbda-4021-45e7-b6b6-7a1918c5c6f1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:18.575593 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4ed6bbda-4021-45e7-b6b6-7a1918c5c6f1 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1731 microversion: 2.20 time: 0.311016 Jun 16 16:24:18.586452 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 552/1095] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:18 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1731 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:18.695103 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-bbc6a904-ef62-4213-a69c-c153669c7a40 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:18.705962 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-bbc6a904-ef62-4213-a69c-c153669c7a40 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1519 microversion: 2.1 time: 0.245131 Jun 16 16:24:18.706542 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 544/1096] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:18 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1519 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:18.999089 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-80fb72b1-87b5-47fd-be6f-64f7b8b998ea tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:19.000679 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-80fb72b1-87b5-47fd-be6f-64f7b8b998ea tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:19.014003 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-80fb72b1-87b5-47fd-be6f-64f7b8b998ea tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:19.014444 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-80fb72b1-87b5-47fd-be6f-64f7b8b998ea tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:19.015770 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-80fb72b1-87b5-47fd-be6f-64f7b8b998ea tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:19.016381 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-80fb72b1-87b5-47fd-be6f-64f7b8b998ea tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:19.043552 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=100 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:19.114413 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-80fb72b1-87b5-47fd-be6f-64f7b8b998ea tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:19.128980 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-80fb72b1-87b5-47fd-be6f-64f7b8b998ea tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1211 microversion: 2.1 time: 0.138255 Jun 16 16:24:19.129775 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 553/1097] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:18 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1211 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:19.599058 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-2e3eba95-e74a-414a-ba36-851d6a0f8d19 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:19.600378 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-2e3eba95-e74a-414a-ba36-851d6a0f8d19 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:19.608750 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2e3eba95-e74a-414a-ba36-851d6a0f8d19 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:19.610239 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2e3eba95-e74a-414a-ba36-851d6a0f8d19 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:19.611507 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2e3eba95-e74a-414a-ba36-851d6a0f8d19 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:19.612068 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-2e3eba95-e74a-414a-ba36-851d6a0f8d19 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:19.726787 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b6d8e1be-e7cc-41b0-9e26-33f6c5a24618 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:19.727978 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-b6d8e1be-e7cc-41b0-9e26-33f6c5a24618 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:19.735545 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b6d8e1be-e7cc-41b0-9e26-33f6c5a24618 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:19.736501 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b6d8e1be-e7cc-41b0-9e26-33f6c5a24618 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:19.737575 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b6d8e1be-e7cc-41b0-9e26-33f6c5a24618 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:19.738408 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-b6d8e1be-e7cc-41b0-9e26-33f6c5a24618 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:19.789568 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2e3eba95-e74a-414a-ba36-851d6a0f8d19 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:19.800774 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2e3eba95-e74a-414a-ba36-851d6a0f8d19 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:19.802516 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-2e3eba95-e74a-414a-ba36-851d6a0f8d19 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:19.803910 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-2e3eba95-e74a-414a-ba36-851d6a0f8d19 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1718 microversion: 2.20 time: 0.211547 Jun 16 16:24:19.804639 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 545/1098] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:19 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1718 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:20.068806 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-b6d8e1be-e7cc-41b0-9e26-33f6c5a24618 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:20.076638 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b6d8e1be-e7cc-41b0-9e26-33f6c5a24618 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1575 microversion: 2.1 time: 0.354690 Jun 16 16:24:20.077229 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 554/1099] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:19 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1575 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:20.148563 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3c1a75ed-a3b2-40ab-b5e2-ad1d3f16b1a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:20.149245 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3c1a75ed-a3b2-40ab-b5e2-ad1d3f16b1a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:20.155669 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c1a75ed-a3b2-40ab-b5e2-ad1d3f16b1a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:20.156807 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c1a75ed-a3b2-40ab-b5e2-ad1d3f16b1a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:20.157591 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c1a75ed-a3b2-40ab-b5e2-ad1d3f16b1a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:20.158057 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3c1a75ed-a3b2-40ab-b5e2-ad1d3f16b1a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:20.173355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:20.316117 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3c1a75ed-a3b2-40ab-b5e2-ad1d3f16b1a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:20.327108 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3c1a75ed-a3b2-40ab-b5e2-ad1d3f16b1a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1267 microversion: 2.1 time: 0.182518 Jun 16 16:24:20.328108 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 546/1100] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:20 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:24:20.705991 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-e2d4b841-d675-4cad-bace-54521a20df21 req-394e25d5-0756-44c9-960b-e0ebfe7665c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73883b1-66a1-4b97-9bb8-9b1cd503adc4", "tag": "64308097-cfca-4e56-bded-c92e6aef946a"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:24:20.721854 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-e2d4b841-d675-4cad-bace-54521a20df21 req-394e25d5-0756-44c9-960b-e0ebfe7665c4 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:20.722720 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-e2d4b841-d675-4cad-bace-54521a20df21 req-394e25d5-0756-44c9-960b-e0ebfe7665c4 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:20.738072 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-e2d4b841-d675-4cad-bace-54521a20df21 req-394e25d5-0756-44c9-960b-e0ebfe7665c4 service nova] Creating event network-changed:64308097-cfca-4e56-bded-c92e6aef946a for instance d73883b1-66a1-4b97-9bb8-9b1cd503adc4 on hv-cinder-83716 Jun 16 16:24:20.743029 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-e2d4b841-d675-4cad-bace-54521a20df21 req-394e25d5-0756-44c9-960b-e0ebfe7665c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044669 Jun 16 16:24:20.743642 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 555/1101] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:24:21.094247 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f95f2f28-2a1c-40cd-b343-2b15d10cff08 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:21.095097 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f95f2f28-2a1c-40cd-b343-2b15d10cff08 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:21.101733 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f95f2f28-2a1c-40cd-b343-2b15d10cff08 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:21.102214 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f95f2f28-2a1c-40cd-b343-2b15d10cff08 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:21.102998 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f95f2f28-2a1c-40cd-b343-2b15d10cff08 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:21.103439 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f95f2f28-2a1c-40cd-b343-2b15d10cff08 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:21.259362 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f95f2f28-2a1c-40cd-b343-2b15d10cff08 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:21.269004 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f95f2f28-2a1c-40cd-b343-2b15d10cff08 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1575 microversion: 2.1 time: 0.179348 Jun 16 16:24:21.269611 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 547/1102] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:21 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:21.348520 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-9fc6e20a-27a7-441b-8091-e1ca1a6259eb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:21.349303 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-9fc6e20a-27a7-441b-8091-e1ca1a6259eb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:21.356219 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9fc6e20a-27a7-441b-8091-e1ca1a6259eb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:21.356674 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9fc6e20a-27a7-441b-8091-e1ca1a6259eb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:21.357454 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9fc6e20a-27a7-441b-8091-e1ca1a6259eb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:21.357893 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9fc6e20a-27a7-441b-8091-e1ca1a6259eb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:21.579886 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-9fc6e20a-27a7-441b-8091-e1ca1a6259eb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:21.587396 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-9fc6e20a-27a7-441b-8091-e1ca1a6259eb tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1267 microversion: 2.1 time: 0.243694 Jun 16 16:24:21.587987 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 556/1103] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:21 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:22.342748 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-52db6f6d-e92a-42dd-8745-7f19201d7ced tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:22.343417 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-52db6f6d-e92a-42dd-8745-7f19201d7ced tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:22.350073 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-52db6f6d-e92a-42dd-8745-7f19201d7ced tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:22.350520 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-52db6f6d-e92a-42dd-8745-7f19201d7ced tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:22.351279 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-52db6f6d-e92a-42dd-8745-7f19201d7ced tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:22.351709 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-52db6f6d-e92a-42dd-8745-7f19201d7ced tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:22.486540 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-52db6f6d-e92a-42dd-8745-7f19201d7ced tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:22.494211 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-52db6f6d-e92a-42dd-8745-7f19201d7ced tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1575 microversion: 2.1 time: 0.155335 Jun 16 16:24:22.494775 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 548/1104] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:22 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:24:22.604282 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-39724a30-ea13-4c83-b185-1a66b10ca873 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:22.604876 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-39724a30-ea13-4c83-b185-1a66b10ca873 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:22.612325 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-39724a30-ea13-4c83-b185-1a66b10ca873 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:22.612786 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-39724a30-ea13-4c83-b185-1a66b10ca873 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:22.613573 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-39724a30-ea13-4c83-b185-1a66b10ca873 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:22.614115 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-39724a30-ea13-4c83-b185-1a66b10ca873 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:22.753602 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-39724a30-ea13-4c83-b185-1a66b10ca873 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:22.761680 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-39724a30-ea13-4c83-b185-1a66b10ca873 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1267 microversion: 2.1 time: 0.161446 Jun 16 16:24:22.762415 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 557/1105] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:22 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:23.513063 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b0e88141-56a9-4ec2-b784-01603afdf654 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:23.513676 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b0e88141-56a9-4ec2-b784-01603afdf654 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:23.521000 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b0e88141-56a9-4ec2-b784-01603afdf654 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:23.521460 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b0e88141-56a9-4ec2-b784-01603afdf654 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:23.522257 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b0e88141-56a9-4ec2-b784-01603afdf654 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:23.522694 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b0e88141-56a9-4ec2-b784-01603afdf654 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:23.667406 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b0e88141-56a9-4ec2-b784-01603afdf654 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:23.675045 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b0e88141-56a9-4ec2-b784-01603afdf654 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1575 microversion: 2.1 time: 0.166129 Jun 16 16:24:23.675619 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 549/1106] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:23 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:23.780142 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f66345cc-f351-4baf-a614-e4216301c6b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:23.782005 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f66345cc-f351-4baf-a614-e4216301c6b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:23.787341 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f66345cc-f351-4baf-a614-e4216301c6b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:23.787798 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f66345cc-f351-4baf-a614-e4216301c6b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:23.788960 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f66345cc-f351-4baf-a614-e4216301c6b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:23.789076 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f66345cc-f351-4baf-a614-e4216301c6b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:23.925551 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-f66345cc-f351-4baf-a614-e4216301c6b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:23.933130 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f66345cc-f351-4baf-a614-e4216301c6b6 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1267 microversion: 2.1 time: 0.156998 Jun 16 16:24:23.933699 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 558/1107] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:23 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:24.692132 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0994f7a7-6bd8-4d59-bde1-53e885fd4a2f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:24.692753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0994f7a7-6bd8-4d59-bde1-53e885fd4a2f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:24.699603 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0994f7a7-6bd8-4d59-bde1-53e885fd4a2f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:24.700055 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0994f7a7-6bd8-4d59-bde1-53e885fd4a2f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:24.700832 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0994f7a7-6bd8-4d59-bde1-53e885fd4a2f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:24.701270 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0994f7a7-6bd8-4d59-bde1-53e885fd4a2f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:24.836158 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-0994f7a7-6bd8-4d59-bde1-53e885fd4a2f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:24.844142 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0994f7a7-6bd8-4d59-bde1-53e885fd4a2f tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1575 microversion: 2.1 time: 0.155741 Jun 16 16:24:24.844627 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 550/1108] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:24 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:24.950879 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-dcb171e5-5dcf-48d5-bbfd-2c53d2749f30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:24.951646 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-dcb171e5-5dcf-48d5-bbfd-2c53d2749f30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:24.958325 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dcb171e5-5dcf-48d5-bbfd-2c53d2749f30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:24.958781 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dcb171e5-5dcf-48d5-bbfd-2c53d2749f30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:24.959557 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dcb171e5-5dcf-48d5-bbfd-2c53d2749f30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:24.959996 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-dcb171e5-5dcf-48d5-bbfd-2c53d2749f30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:25.095806 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-dcb171e5-5dcf-48d5-bbfd-2c53d2749f30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:25.104104 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-dcb171e5-5dcf-48d5-bbfd-2c53d2749f30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1267 microversion: 2.1 time: 0.157156 Jun 16 16:24:25.104735 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 559/1109] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:24 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:25.861128 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-977a0024-7c2b-4cfc-a7d6-819c2217b134 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:25.861669 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-977a0024-7c2b-4cfc-a7d6-819c2217b134 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:25.868167 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-977a0024-7c2b-4cfc-a7d6-819c2217b134 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:25.868635 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-977a0024-7c2b-4cfc-a7d6-819c2217b134 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:25.869404 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-977a0024-7c2b-4cfc-a7d6-819c2217b134 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:25.869837 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-977a0024-7c2b-4cfc-a7d6-819c2217b134 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:26.022483 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-977a0024-7c2b-4cfc-a7d6-819c2217b134 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:26.032594 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-977a0024-7c2b-4cfc-a7d6-819c2217b134 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1575 microversion: 2.1 time: 0.175498 Jun 16 16:24:26.033310 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 551/1110] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:25 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:26.122193 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-727f339f-9ed5-4e52-a896-deb13770bb23 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:26.122863 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-727f339f-9ed5-4e52-a896-deb13770bb23 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:26.129866 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-727f339f-9ed5-4e52-a896-deb13770bb23 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:26.130345 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-727f339f-9ed5-4e52-a896-deb13770bb23 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:26.131127 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-727f339f-9ed5-4e52-a896-deb13770bb23 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:26.131573 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-727f339f-9ed5-4e52-a896-deb13770bb23 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:26.282253 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-727f339f-9ed5-4e52-a896-deb13770bb23 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:26.289967 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-727f339f-9ed5-4e52-a896-deb13770bb23 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1267 microversion: 2.1 time: 0.171806 Jun 16 16:24:26.290542 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 560/1111] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:26 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:24:27.051655 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-373496b1-0a84-4f54-b325-b0cef3771d18 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:27.052275 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-373496b1-0a84-4f54-b325-b0cef3771d18 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:27.054338 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=2 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:27.055018 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=6 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:27.061256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-373496b1-0a84-4f54-b325-b0cef3771d18 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:27.061697 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-373496b1-0a84-4f54-b325-b0cef3771d18 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:27.063807 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-373496b1-0a84-4f54-b325-b0cef3771d18 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:27.064250 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-373496b1-0a84-4f54-b325-b0cef3771d18 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:27.207096 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-373496b1-0a84-4f54-b325-b0cef3771d18 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:27.214888 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-373496b1-0a84-4f54-b325-b0cef3771d18 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1575 microversion: 2.1 time: 0.168168 Jun 16 16:24:27.215471 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 552/1112] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:27 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:24:27.307558 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-4eb4b352-db46-4dcf-8a2a-e937218827d7 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:27.308094 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-4eb4b352-db46-4dcf-8a2a-e937218827d7 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:27.311383 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:27.314295 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:27.319601 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4eb4b352-db46-4dcf-8a2a-e937218827d7 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:27.320058 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4eb4b352-db46-4dcf-8a2a-e937218827d7 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:27.320840 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4eb4b352-db46-4dcf-8a2a-e937218827d7 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:27.321280 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-4eb4b352-db46-4dcf-8a2a-e937218827d7 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:27.464819 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-4eb4b352-db46-4dcf-8a2a-e937218827d7 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:27.473506 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-4eb4b352-db46-4dcf-8a2a-e937218827d7 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1267 microversion: 2.1 time: 0.169846 Jun 16 16:24:27.474126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 561/1113] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:27 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:28.232242 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b9f491b0-d86a-4dd1-b186-7e3650e829a5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:28.232977 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b9f491b0-d86a-4dd1-b186-7e3650e829a5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:28.235614 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:28.241761 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9f491b0-d86a-4dd1-b186-7e3650e829a5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:28.242241 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9f491b0-d86a-4dd1-b186-7e3650e829a5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:28.243023 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9f491b0-d86a-4dd1-b186-7e3650e829a5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:28.243460 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b9f491b0-d86a-4dd1-b186-7e3650e829a5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:28.393889 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b9f491b0-d86a-4dd1-b186-7e3650e829a5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:28.401881 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b9f491b0-d86a-4dd1-b186-7e3650e829a5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1575 microversion: 2.1 time: 0.173415 Jun 16 16:24:28.402527 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 553/1114] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:28 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:28.490644 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-363dd3f2-9fe8-4731-a518-d48f593444ba tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:28.491454 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-363dd3f2-9fe8-4731-a518-d48f593444ba tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:28.498554 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-363dd3f2-9fe8-4731-a518-d48f593444ba tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:28.499065 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-363dd3f2-9fe8-4731-a518-d48f593444ba tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:28.500632 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-363dd3f2-9fe8-4731-a518-d48f593444ba tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:28.501091 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-363dd3f2-9fe8-4731-a518-d48f593444ba tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:28.653279 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-363dd3f2-9fe8-4731-a518-d48f593444ba tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:28.661219 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-363dd3f2-9fe8-4731-a518-d48f593444ba tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1267 microversion: 2.1 time: 0.174492 Jun 16 16:24:28.661798 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 562/1115] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:28 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:29.420162 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b1fd95e9-5f49-4d67-8efa-8cb64aa290d5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:29.420774 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b1fd95e9-5f49-4d67-8efa-8cb64aa290d5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:29.428468 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b1fd95e9-5f49-4d67-8efa-8cb64aa290d5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:29.428917 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b1fd95e9-5f49-4d67-8efa-8cb64aa290d5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:29.429884 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b1fd95e9-5f49-4d67-8efa-8cb64aa290d5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:29.430348 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b1fd95e9-5f49-4d67-8efa-8cb64aa290d5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:29.592480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b1fd95e9-5f49-4d67-8efa-8cb64aa290d5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:29.601189 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b1fd95e9-5f49-4d67-8efa-8cb64aa290d5 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1575 microversion: 2.1 time: 0.185082 Jun 16 16:24:29.601799 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 554/1116] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:29 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:29.679015 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a6223779-8695-4a72-ac67-bf9daff9193f tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:29.679649 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a6223779-8695-4a72-ac67-bf9daff9193f tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:29.686456 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a6223779-8695-4a72-ac67-bf9daff9193f tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:29.686906 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a6223779-8695-4a72-ac67-bf9daff9193f tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:29.688264 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a6223779-8695-4a72-ac67-bf9daff9193f tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:29.688816 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a6223779-8695-4a72-ac67-bf9daff9193f tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:29.830970 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-a6223779-8695-4a72-ac67-bf9daff9193f tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:29.842006 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a6223779-8695-4a72-ac67-bf9daff9193f tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1267 microversion: 2.1 time: 0.166631 Jun 16 16:24:29.842863 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 563/1117] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:29 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:30.192640 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-79c239cb-f66a-470d-9391-ea0c93ccccc2 req-0fef3337-5665-4e69-8dd7-0dd4dbcba13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73883b1-66a1-4b97-9bb8-9b1cd503adc4", "name": "network-vif-plugged", "status": "completed", "tag": "64308097-cfca-4e56-bded-c92e6aef946a"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:24:30.201707 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-79c239cb-f66a-470d-9391-ea0c93ccccc2 req-0fef3337-5665-4e69-8dd7-0dd4dbcba13e service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:30.202533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-79c239cb-f66a-470d-9391-ea0c93ccccc2 req-0fef3337-5665-4e69-8dd7-0dd4dbcba13e service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:30.215120 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-79c239cb-f66a-470d-9391-ea0c93ccccc2 req-0fef3337-5665-4e69-8dd7-0dd4dbcba13e service nova] Creating event network-vif-plugged:64308097-cfca-4e56-bded-c92e6aef946a for instance d73883b1-66a1-4b97-9bb8-9b1cd503adc4 on hv-cinder-83716 Jun 16 16:24:30.221207 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-79c239cb-f66a-470d-9391-ea0c93ccccc2 req-0fef3337-5665-4e69-8dd7-0dd4dbcba13e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032185 Jun 16 16:24:30.222101 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 555/1118] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:24:30.620779 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ed13e61b-d3f0-498b-9611-8ee53f29ba2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:30.621470 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ed13e61b-d3f0-498b-9611-8ee53f29ba2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:30.628599 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ed13e61b-d3f0-498b-9611-8ee53f29ba2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:30.629060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ed13e61b-d3f0-498b-9611-8ee53f29ba2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:30.629860 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ed13e61b-d3f0-498b-9611-8ee53f29ba2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:30.630330 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ed13e61b-d3f0-498b-9611-8ee53f29ba2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:30.779170 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-ed13e61b-d3f0-498b-9611-8ee53f29ba2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:30.788515 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ed13e61b-d3f0-498b-9611-8ee53f29ba2b tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1575 microversion: 2.1 time: 0.172200 Jun 16 16:24:30.789335 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 564/1119] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:30 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:30.865879 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-efe42b0b-e204-45ae-b6c9-3bc2502cb149 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:30.866720 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-efe42b0b-e204-45ae-b6c9-3bc2502cb149 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:30.873696 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-efe42b0b-e204-45ae-b6c9-3bc2502cb149 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:30.874189 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-efe42b0b-e204-45ae-b6c9-3bc2502cb149 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:30.875079 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-efe42b0b-e204-45ae-b6c9-3bc2502cb149 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:30.875569 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-efe42b0b-e204-45ae-b6c9-3bc2502cb149 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:31.045009 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-efe42b0b-e204-45ae-b6c9-3bc2502cb149 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:31.052665 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-efe42b0b-e204-45ae-b6c9-3bc2502cb149 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1267 microversion: 2.1 time: 0.191767 Jun 16 16:24:31.053233 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 556/1120] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:30 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:31.808903 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8800e66e-b0bc-48fb-8b84-8065cc4eb07d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:31.810006 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8800e66e-b0bc-48fb-8b84-8065cc4eb07d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:31.820813 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8800e66e-b0bc-48fb-8b84-8065cc4eb07d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:31.821504 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8800e66e-b0bc-48fb-8b84-8065cc4eb07d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:31.823070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8800e66e-b0bc-48fb-8b84-8065cc4eb07d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:31.823225 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8800e66e-b0bc-48fb-8b84-8065cc4eb07d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:31.969765 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8800e66e-b0bc-48fb-8b84-8065cc4eb07d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:31.977732 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8800e66e-b0bc-48fb-8b84-8065cc4eb07d tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1575 microversion: 2.1 time: 0.175203 Jun 16 16:24:31.978321 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 565/1121] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:31 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:32.075480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-1312acdc-51ec-4c37-acdb-22a5d02abab2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:32.076272 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-1312acdc-51ec-4c37-acdb-22a5d02abab2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:32.083308 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1312acdc-51ec-4c37-acdb-22a5d02abab2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:32.083835 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1312acdc-51ec-4c37-acdb-22a5d02abab2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:32.084550 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1312acdc-51ec-4c37-acdb-22a5d02abab2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:32.084995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-1312acdc-51ec-4c37-acdb-22a5d02abab2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:32.244336 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-45d282bf-0722-4ff8-8a60-90bda84e23a2 req-da8ef2be-96a5-4d10-a0c1-2eddf87b69eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3edfd3e1-fd3e-4455-a860-d55a2f67ef3d", "name": "network-vif-plugged", "status": "completed", "tag": "d9220eec-1f6d-431f-9e5e-4374035faf5f"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:24:32.251842 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-1312acdc-51ec-4c37-acdb-22a5d02abab2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:32.253625 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-45d282bf-0722-4ff8-8a60-90bda84e23a2 req-da8ef2be-96a5-4d10-a0c1-2eddf87b69eb service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:32.254115 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-45d282bf-0722-4ff8-8a60-90bda84e23a2 req-da8ef2be-96a5-4d10-a0c1-2eddf87b69eb service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:32.259928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-1312acdc-51ec-4c37-acdb-22a5d02abab2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1453 microversion: 2.1 time: 0.188279 Jun 16 16:24:32.260757 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 557/1122] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:32 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:24:32.268555 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-45d282bf-0722-4ff8-8a60-90bda84e23a2 req-da8ef2be-96a5-4d10-a0c1-2eddf87b69eb service nova] Creating event network-vif-plugged:d9220eec-1f6d-431f-9e5e-4374035faf5f for instance 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d on hv-cinder-83716 Jun 16 16:24:32.274853 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-45d282bf-0722-4ff8-8a60-90bda84e23a2 req-da8ef2be-96a5-4d10-a0c1-2eddf87b69eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034180 Jun 16 16:24:32.275629 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 566/1123] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:24:32.278981 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-3b9473ca-37d6-48d7-93c0-bc49cb1516a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:32.279596 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-3b9473ca-37d6-48d7-93c0-bc49cb1516a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:32.286502 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3b9473ca-37d6-48d7-93c0-bc49cb1516a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:32.287267 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3b9473ca-37d6-48d7-93c0-bc49cb1516a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:32.288558 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3b9473ca-37d6-48d7-93c0-bc49cb1516a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:32.289274 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-3b9473ca-37d6-48d7-93c0-bc49cb1516a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:32.463081 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-3b9473ca-37d6-48d7-93c0-bc49cb1516a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:32.472718 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-3b9473ca-37d6-48d7-93c0-bc49cb1516a1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1453 microversion: 2.1 time: 0.197607 Jun 16 16:24:32.473580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 558/1124] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:32 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:32.998042 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-759371c2-ca15-4692-90e2-a84697c9bef1 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:32.998922 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-759371c2-ca15-4692-90e2-a84697c9bef1 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:33.006571 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-759371c2-ca15-4692-90e2-a84697c9bef1 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:33.007134 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-759371c2-ca15-4692-90e2-a84697c9bef1 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:33.008035 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-759371c2-ca15-4692-90e2-a84697c9bef1 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:33.008483 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-759371c2-ca15-4692-90e2-a84697c9bef1 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:33.189600 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-759371c2-ca15-4692-90e2-a84697c9bef1 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:33.198190 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-759371c2-ca15-4692-90e2-a84697c9bef1 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1575 microversion: 2.1 time: 0.205346 Jun 16 16:24:33.198881 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 567/1125] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:32 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:34.220064 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-fa7d6012-0ce4-4663-84f7-d3709c451f15 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:34.220947 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-fa7d6012-0ce4-4663-84f7-d3709c451f15 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:34.227831 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa7d6012-0ce4-4663-84f7-d3709c451f15 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:34.229836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa7d6012-0ce4-4663-84f7-d3709c451f15 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:34.229836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa7d6012-0ce4-4663-84f7-d3709c451f15 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:34.229836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-fa7d6012-0ce4-4663-84f7-d3709c451f15 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:34.493316 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-fa7d6012-0ce4-4663-84f7-d3709c451f15 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:34.502810 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-fa7d6012-0ce4-4663-84f7-d3709c451f15 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1575 microversion: 2.1 time: 0.287757 Jun 16 16:24:34.503392 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 559/1126] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:34 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1575 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:34.941116 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-484eeb2d-e27d-4953-aace-33b035436608 req-aa12b89b-ff36-414f-aaff-8769fb30c6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73883b1-66a1-4b97-9bb8-9b1cd503adc4", "tag": "64308097-cfca-4e56-bded-c92e6aef946a"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:24:34.950841 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-484eeb2d-e27d-4953-aace-33b035436608 req-aa12b89b-ff36-414f-aaff-8769fb30c6d4 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:34.951436 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-484eeb2d-e27d-4953-aace-33b035436608 req-aa12b89b-ff36-414f-aaff-8769fb30c6d4 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:34.967381 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-484eeb2d-e27d-4953-aace-33b035436608 req-aa12b89b-ff36-414f-aaff-8769fb30c6d4 service nova] Creating event network-changed:64308097-cfca-4e56-bded-c92e6aef946a for instance d73883b1-66a1-4b97-9bb8-9b1cd503adc4 on hv-cinder-83716 Jun 16 16:24:34.978070 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-484eeb2d-e27d-4953-aace-33b035436608 req-aa12b89b-ff36-414f-aaff-8769fb30c6d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192413 Jun 16 16:24:34.978679 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 568/1127] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:24:35.525857 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-5a568ca4-cb13-4a15-8488-99f6eca7b4aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:35.527145 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-5a568ca4-cb13-4a15-8488-99f6eca7b4aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:35.538970 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a568ca4-cb13-4a15-8488-99f6eca7b4aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:35.539561 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a568ca4-cb13-4a15-8488-99f6eca7b4aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:35.540355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a568ca4-cb13-4a15-8488-99f6eca7b4aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:35.540947 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-5a568ca4-cb13-4a15-8488-99f6eca7b4aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:35.741254 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-5a568ca4-cb13-4a15-8488-99f6eca7b4aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:35.752289 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-5a568ca4-cb13-4a15-8488-99f6eca7b4aa tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1562 microversion: 2.1 time: 0.234039 Jun 16 16:24:35.752852 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 560/1128] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:35 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1562 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:44.438027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:24:44.438635 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Thu Jun 16 16:24:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:24:59.287149 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=15 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:59.288156 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=80 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:59.293752 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a6a45adb-73dc-4af4-a7e4-892253b20087 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:59.295016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-a6a45adb-73dc-4af4-a7e4-892253b20087 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:59.304171 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a6a45adb-73dc-4af4-a7e4-892253b20087 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:59.304646 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a6a45adb-73dc-4af4-a7e4-892253b20087 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:59.305693 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a6a45adb-73dc-4af4-a7e4-892253b20087 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:59.306279 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-a6a45adb-73dc-4af4-a7e4-892253b20087 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:59.354113 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a6a45adb-73dc-4af4-a7e4-892253b20087 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.068546 Jun 16 16:24:59.354752 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 569/1129] 10.222.0.17 () {60 vars in 1342 bytes} [Thu Jun 16 16:24:59 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:24:59.424794 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-7e823cf0-e631-4a49-b56a-4d2b32a527b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:59.425393 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7e823cf0-e631-4a49-b56a-4d2b32a527b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:59.428540 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=15 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:59.429575 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=83 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:59.438444 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e823cf0-e631-4a49-b56a-4d2b32a527b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:59.439033 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e823cf0-e631-4a49-b56a-4d2b32a527b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:59.439843 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e823cf0-e631-4a49-b56a-4d2b32a527b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:59.440290 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-7e823cf0-e631-4a49-b56a-4d2b32a527b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:59.478351 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-7e823cf0-e631-4a49-b56a-4d2b32a527b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:24:59.593690 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-7e823cf0-e631-4a49-b56a-4d2b32a527b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 204 len: 0 microversion: 2.20 time: 0.173815 Jun 16 16:24:59.594732 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 561/1130] 10.222.0.17 () {60 vars in 1279 bytes} [Thu Jun 16 16:24:59 2022] DELETE /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 16:24:59.606124 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7b90db73-2239-445f-9655-a0f3be73c63e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:59.606762 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7b90db73-2239-445f-9655-a0f3be73c63e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:59.614875 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7b90db73-2239-445f-9655-a0f3be73c63e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:59.615484 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7b90db73-2239-445f-9655-a0f3be73c63e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:59.616485 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7b90db73-2239-445f-9655-a0f3be73c63e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:59.617040 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7b90db73-2239-445f-9655-a0f3be73c63e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:00.088327 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7b90db73-2239-445f-9655-a0f3be73c63e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:00.098930 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7b90db73-2239-445f-9655-a0f3be73c63e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:00.100519 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-7b90db73-2239-445f-9655-a0f3be73c63e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:00.102177 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7b90db73-2239-445f-9655-a0f3be73c63e tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1724 microversion: 2.20 time: 0.501942 Jun 16 16:25:00.103497 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 570/1131] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:59 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1724 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:25:01.128077 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-db4ff487-296d-4aaf-942d-94a87de66fbc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:01.129157 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-db4ff487-296d-4aaf-942d-94a87de66fbc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:01.138074 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db4ff487-296d-4aaf-942d-94a87de66fbc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:01.138604 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db4ff487-296d-4aaf-942d-94a87de66fbc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:01.140003 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db4ff487-296d-4aaf-942d-94a87de66fbc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:01.140479 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-db4ff487-296d-4aaf-942d-94a87de66fbc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:01.312961 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-db4ff487-296d-4aaf-942d-94a87de66fbc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:01.325241 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-db4ff487-296d-4aaf-942d-94a87de66fbc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:01.328310 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-db4ff487-296d-4aaf-942d-94a87de66fbc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:01.329331 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-db4ff487-296d-4aaf-942d-94a87de66fbc tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1724 microversion: 2.20 time: 0.207861 Jun 16 16:25:01.329906 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 562/1132] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:25:01 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:25:02.350882 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-10134b44-e2f7-4c0b-ab74-236874c18553 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:02.351921 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-10134b44-e2f7-4c0b-ab74-236874c18553 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:02.360186 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-10134b44-e2f7-4c0b-ab74-236874c18553 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:02.361400 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-10134b44-e2f7-4c0b-ab74-236874c18553 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:02.362647 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-10134b44-e2f7-4c0b-ab74-236874c18553 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:02.363424 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-10134b44-e2f7-4c0b-ab74-236874c18553 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:02.443796 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-10134b44-e2f7-4c0b-ab74-236874c18553 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:02.454004 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-10134b44-e2f7-4c0b-ab74-236874c18553 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:02.455556 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-10134b44-e2f7-4c0b-ab74-236874c18553 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b32b74cc1e44ce5a7e687e3c04e8099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5411e6d1c7a94aeeaaa8a0a30fb4887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:02.456795 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-10134b44-e2f7-4c0b-ab74-236874c18553 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 200 len: 1657 microversion: 2.20 time: 0.111177 Jun 16 16:25:02.457361 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 571/1133] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:25:02 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 1657 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:25:02.579533 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-b551857a-76f7-4855-a553-74fade740272 req-3dfcad04-c3af-4e50-8b9b-beb09003da70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c39c574-58f7-40d4-8586-71b6d0e43ad8", "name": "network-vif-deleted", "tag": "5ee1def3-312f-411f-9c12-54728972e3ff"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:25:02.589140 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-b551857a-76f7-4855-a553-74fade740272 req-3dfcad04-c3af-4e50-8b9b-beb09003da70 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:02.589590 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-b551857a-76f7-4855-a553-74fade740272 req-3dfcad04-c3af-4e50-8b9b-beb09003da70 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:02.604759 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-b551857a-76f7-4855-a553-74fade740272 req-3dfcad04-c3af-4e50-8b9b-beb09003da70 service nova] Creating event network-vif-deleted:5ee1def3-312f-411f-9c12-54728972e3ff for instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 on hv-cinder-83716 Jun 16 16:25:02.612043 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-b551857a-76f7-4855-a553-74fade740272 req-3dfcad04-c3af-4e50-8b9b-beb09003da70 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036813 Jun 16 16:25:02.613055 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 563/1134] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:25:03.478073 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ce3753ed-ecae-41c1-b87e-0b630ba7a1b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:03.478839 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-ce3753ed-ecae-41c1-b87e-0b630ba7a1b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:03.486793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ce3753ed-ecae-41c1-b87e-0b630ba7a1b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:03.487315 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ce3753ed-ecae-41c1-b87e-0b630ba7a1b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:03.488334 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ce3753ed-ecae-41c1-b87e-0b630ba7a1b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:03.488778 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-ce3753ed-ecae-41c1-b87e-0b630ba7a1b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:03.507672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-ce3753ed-ecae-41c1-b87e-0b630ba7a1b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] HTTP exception thrown: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ce3753ed-ecae-41c1-b87e-0b630ba7a1b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Request method failure captured: Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 HTTP/1.1 Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1gS2l6U9rLTip3WT1qkw2xr9sX4nprulYxbTHgb46o4FZl_eahvvFPWGGFsRb4hM3vMRMYwBcrwNDFyYre9SbIYIYLVFuKuP_S6EOcuOp_alskU_kopoH0jE2YK9HxugtdU7nWRZmrJK9s6l5CvMEJhQeS_FfLuXX2wuo0Zux0sxaw Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 5411e6d1c7a94aeeaaa8a0a30fb4887b Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:25:03.510060 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:25:03.513117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}] Jun 16 16:25:03.513117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:25:03.513117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 5411e6d1c7a94aeeaaa8a0a30fb4887b Jun 16 16:25:03.513117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:25:03.513117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-AttachVolumeShelveTestJSON-2130906217-project Jun 16 16:25:03.513117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:25:03.513117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:25:03.513117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 2b32b74cc1e44ce5a7e687e3c04e8099 Jun 16 16:25:03.513117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2130906217-project Jun 16 16:25:03.513117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:25:03.513117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. Jun 16 16:25:03.513117 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': '3c39c574-58f7-40d4-8586-71b6d0e43ad8'} Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:25:03.516126 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. Jun 16 16:25:03.519985 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:03.527867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-ce3753ed-ecae-41c1-b87e-0b630ba7a1b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Returning 404 to user: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:25:03.527867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-ce3753ed-ecae-41c1-b87e-0b630ba7a1b5 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 404 len: 111 microversion: 2.20 time: 0.052204 Jun 16 16:25:03.529188 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 572/1135] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:25:03 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:25:03.539435 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-41519a4c-75fd-476d-aeb7-1e0aa90213cb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '.version_select at 0x7f38bb7e7160>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:03.565025 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-41519a4c-75fd-476d-aeb7-1e0aa90213cb tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221745058" status: 204 len: 0 microversion: 2.20 time: 0.029781 Jun 16 16:25:03.565637 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 564/1136] 10.222.0.17 () {60 vars in 1261 bytes} [Thu Jun 16 16:25:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221745058 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 16:25:05.455602 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1cb9911a-2f95-4a8f-b9c1-7b7146eb6519 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:05.456036 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-1cb9911a-2f95-4a8f-b9c1-7b7146eb6519 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:05.463022 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1cb9911a-2f95-4a8f-b9c1-7b7146eb6519 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:05.463480 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1cb9911a-2f95-4a8f-b9c1-7b7146eb6519 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:05.464261 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1cb9911a-2f95-4a8f-b9c1-7b7146eb6519 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:05.464692 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-1cb9911a-2f95-4a8f-b9c1-7b7146eb6519 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:05.479582 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-1cb9911a-2f95-4a8f-b9c1-7b7146eb6519 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] HTTP exception thrown: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1cb9911a-2f95-4a8f-b9c1-7b7146eb6519 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Request method failure captured: Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: DELETE /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 HTTP/1.1 Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1gS2l6U9rLTip3WT1qkw2xr9sX4nprulYxbTHgb46o4FZl_eahvvFPWGGFsRb4hM3vMRMYwBcrwNDFyYre9SbIYIYLVFuKuP_S6EOcuOp_alskU_kopoH0jE2YK9HxugtdU7nWRZmrJK9s6l5CvMEJhQeS_FfLuXX2wuo0Zux0sxaw Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 5411e6d1c7a94aeeaaa8a0a30fb4887b Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:25:05.481133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:25:05.483333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}] Jun 16 16:25:05.483333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:25:05.483333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 5411e6d1c7a94aeeaaa8a0a30fb4887b Jun 16 16:25:05.483333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:25:05.483333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-AttachVolumeShelveTestJSON-2130906217-project Jun 16 16:25:05.483333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:25:05.483333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:25:05.483333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 2b32b74cc1e44ce5a7e687e3c04e8099 Jun 16 16:25:05.483333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2130906217-project Jun 16 16:25:05.483333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:25:05.483333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. Jun 16 16:25:05.483333 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': '3c39c574-58f7-40d4-8586-71b6d0e43ad8'} Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:25:05.484274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. Jun 16 16:25:05.485858 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:05.487494 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1cb9911a-2f95-4a8f-b9c1-7b7146eb6519 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Returning 404 to user: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:25:05.487494 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1cb9911a-2f95-4a8f-b9c1-7b7146eb6519 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 404 len: 111 microversion: 2.20 time: 0.032038 Jun 16 16:25:05.487494 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 573/1137] 10.222.0.17 () {60 vars in 1279 bytes} [Thu Jun 16 16:25:05 2022] DELETE /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:25:05.493317 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-930d4380-d073-4149-a76d-2bb65923e3d2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:05.494091 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-930d4380-d073-4149-a76d-2bb65923e3d2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 3c39c574-58f7-40d4-8586-71b6d0e43ad8] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:05.501387 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-930d4380-d073-4149-a76d-2bb65923e3d2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:05.501836 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-930d4380-d073-4149-a76d-2bb65923e3d2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:05.502647 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-930d4380-d073-4149-a76d-2bb65923e3d2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:05.503090 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-930d4380-d073-4149-a76d-2bb65923e3d2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:05.517158 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-930d4380-d073-4149-a76d-2bb65923e3d2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] HTTP exception thrown: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-930d4380-d073-4149-a76d-2bb65923e3d2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Request method failure captured: Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 HTTP/1.1 Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1gS2l6U9rLTip3WT1qkw2xr9sX4nprulYxbTHgb46o4FZl_eahvvFPWGGFsRb4hM3vMRMYwBcrwNDFyYre9SbIYIYLVFuKuP_S6EOcuOp_alskU_kopoH0jE2YK9HxugtdU7nWRZmrJK9s6l5CvMEJhQeS_FfLuXX2wuo0Zux0sxaw Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 5411e6d1c7a94aeeaaa8a0a30fb4887b Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:25:05.518848 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:25:05.520559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}] Jun 16 16:25:05.520559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:25:05.520559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 5411e6d1c7a94aeeaaa8a0a30fb4887b Jun 16 16:25:05.520559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:25:05.520559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeShelveTestJSON-2130906217-project Jun 16 16:25:05.520559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:25:05.520559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:25:05.520559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 2b32b74cc1e44ce5a7e687e3c04e8099 Jun 16 16:25:05.520559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2130906217-project Jun 16 16:25:05.520559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:25:05.520559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. Jun 16 16:25:05.520559 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': '3c39c574-58f7-40d4-8586-71b6d0e43ad8'} Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:25:05.521480 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. Jun 16 16:25:05.523110 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:05.524552 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-930d4380-d073-4149-a76d-2bb65923e3d2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Returning 404 to user: Instance 3c39c574-58f7-40d4-8586-71b6d0e43ad8 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:25:05.524552 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-930d4380-d073-4149-a76d-2bb65923e3d2 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8" status: 404 len: 111 microversion: 2.20 time: 0.031344 Jun 16 16:25:05.524552 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 565/1138] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:25:05 2022] GET /compute/v2.1/servers/3c39c574-58f7-40d4-8586-71b6d0e43ad8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:25:06.666568 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c01d256d-5164-4d46-8d2a-9287199b3ed6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:06.667112 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-c01d256d-5164-4d46-8d2a-9287199b3ed6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:06.674655 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c01d256d-5164-4d46-8d2a-9287199b3ed6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:06.675300 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c01d256d-5164-4d46-8d2a-9287199b3ed6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:06.676027 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c01d256d-5164-4d46-8d2a-9287199b3ed6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:06.676468 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-c01d256d-5164-4d46-8d2a-9287199b3ed6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:06.690895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-c01d256d-5164-4d46-8d2a-9287199b3ed6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] HTTP exception thrown: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c01d256d-5164-4d46-8d2a-9287199b3ed6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Request method failure captured: Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: DELETE /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 HTTP/1.1 Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1gS2l6U9rLTip3WT1qkw2xr9sX4nprulYxbTHgb46o4FZl_eahvvFPWGGFsRb4hM3vMRMYwBcrwNDFyYre9SbIYIYLVFuKuP_S6EOcuOp_alskU_kopoH0jE2YK9HxugtdU7nWRZmrJK9s6l5CvMEJhQeS_FfLuXX2wuo0Zux0sxaw Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 5411e6d1c7a94aeeaaa8a0a30fb4887b Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:25:06.692652 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:25:06.694406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}] Jun 16 16:25:06.694406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:25:06.694406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 5411e6d1c7a94aeeaaa8a0a30fb4887b Jun 16 16:25:06.694406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:25:06.694406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-AttachVolumeShelveTestJSON-2130906217-project Jun 16 16:25:06.694406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:25:06.694406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:25:06.694406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 2b32b74cc1e44ce5a7e687e3c04e8099 Jun 16 16:25:06.694406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2130906217-project Jun 16 16:25:06.694406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:25:06.694406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. Jun 16 16:25:06.694406 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': '4412fc83-e558-4531-8295-ee5a4f1ba983'} Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:25:06.695472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. Jun 16 16:25:06.697174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:06.698814 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-c01d256d-5164-4d46-8d2a-9287199b3ed6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Returning 404 to user: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:25:06.698814 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-c01d256d-5164-4d46-8d2a-9287199b3ed6 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 404 len: 111 microversion: 2.20 time: 0.031810 Jun 16 16:25:06.698814 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 574/1139] 10.222.0.17 () {60 vars in 1279 bytes} [Thu Jun 16 16:25:06 2022] DELETE /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:25:06.703381 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e163b412-998e-4311-982b-1886875b6ba4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:06.704000 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-e163b412-998e-4311-982b-1886875b6ba4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] [instance: 4412fc83-e558-4531-8295-ee5a4f1ba983] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:06.710727 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e163b412-998e-4311-982b-1886875b6ba4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:06.711181 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e163b412-998e-4311-982b-1886875b6ba4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:06.711957 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e163b412-998e-4311-982b-1886875b6ba4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:06.712401 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-e163b412-998e-4311-982b-1886875b6ba4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:06.726569 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-e163b412-998e-4311-982b-1886875b6ba4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] HTTP exception thrown: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e163b412-998e-4311-982b-1886875b6ba4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Request method failure captured: Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 HTTP/1.1 Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1gS2l6U9rLTip3WT1qkw2xr9sX4nprulYxbTHgb46o4FZl_eahvvFPWGGFsRb4hM3vMRMYwBcrwNDFyYre9SbIYIYLVFuKuP_S6EOcuOp_alskU_kopoH0jE2YK9HxugtdU7nWRZmrJK9s6l5CvMEJhQeS_FfLuXX2wuo0Zux0sxaw Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 5411e6d1c7a94aeeaaa8a0a30fb4887b Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:25:06.728125 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:25:06.729806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5411e6d1c7a94aeeaaa8a0a30fb4887b"}]}] Jun 16 16:25:06.729806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:25:06.729806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 5411e6d1c7a94aeeaaa8a0a30fb4887b Jun 16 16:25:06.729806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2130906217 Jun 16 16:25:06.729806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-AttachVolumeShelveTestJSON-2130906217-project Jun 16 16:25:06.729806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:25:06.729806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:25:06.729806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 2b32b74cc1e44ce5a7e687e3c04e8099 Jun 16 16:25:06.729806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2130906217-project Jun 16 16:25:06.729806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:25:06.729806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. Jun 16 16:25:06.729806 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': '4412fc83-e558-4531-8295-ee5a4f1ba983'} Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:25:06.730753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. Jun 16 16:25:06.732225 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:06.734608 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-e163b412-998e-4311-982b-1886875b6ba4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] Returning 404 to user: Instance 4412fc83-e558-4531-8295-ee5a4f1ba983 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:25:06.734608 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-e163b412-998e-4311-982b-1886875b6ba4 tempest-AttachVolumeShelveTestJSON-2130906217 tempest-AttachVolumeShelveTestJSON-2130906217-project] 10.222.0.17 "GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983" status: 404 len: 111 microversion: 2.20 time: 0.030359 Jun 16 16:25:06.734608 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 566/1140] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 16:25:06 2022] GET /compute/v2.1/servers/4412fc83-e558-4531-8295-ee5a4f1ba983 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 16:25:11.511051 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f56582f1-b7c1-4224-b8a9-fa5be7458b66 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Action: 'create', calling method: .version_select at 0x7f38bb4cea60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-566661583"}} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:25:11.831942 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f56582f1-b7c1-4224-b8a9-fa5be7458b66 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.462855 Jun 16 16:25:11.832537 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 575/1141] 10.222.0.17 () {60 vars in 1154 bytes} [Thu Jun 16 16:25:11 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 464 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 16:25:11.849983 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-acc5c808-35c1-4b01-8162-37be52524a7c tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38bb68f820>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:11.922352 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-acc5c808-35c1-4b01-8162-37be52524a7c tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21" status: 200 len: 344 microversion: 2.1 time: 0.078315 Jun 16 16:25:11.922932 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 567/1142] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:25:11 2022] GET /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:25:12.935071 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e139fc8e-f19d-4137-924d-4827a5ea26f9 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38bbfe3430>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:12.984462 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e139fc8e-f19d-4137-924d-4827a5ea26f9 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21" status: 200 len: 345 microversion: 2.1 time: 0.053630 Jun 16 16:25:12.985023 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 576/1143] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:25:12 2022] GET /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:25:12.997541 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-effd3dce-8917-40c6-bb3c-1ac4e72d25a6 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Action: 'create', calling method: .version_select at 0x7f38bb4331f0>, body: {"snapshot": {"volume_id": "da5444c5-8678-4f79-a30c-b315dc195f21", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1152584035"}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:25:13.157955 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-effd3dce-8917-40c6-bb3c-1ac4e72d25a6 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.164852 Jun 16 16:25:13.158631 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 568/1144] 10.222.0.17 () {60 vars in 1161 bytes} [Thu Jun 16 16:25:12 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:25:13.169145 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-1af30042-c3ee-4597-b924-1de301f383d8 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38bbf82790>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:13.211224 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-1af30042-c3ee-4597-b924-1de301f383d8 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65" status: 200 len: 287 microversion: 2.1 time: 0.045457 Jun 16 16:25:13.212787 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 577/1145] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 16:25:13 2022] GET /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:25:13.223549 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ffbe323c-8b6f-4617-8604-6a3a2f979577 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38bb790c10>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:13.257871 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ffbe323c-8b6f-4617-8604-6a3a2f979577 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.038141 Jun 16 16:25:13.258637 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 569/1146] 10.222.0.17 () {58 vars in 1139 bytes} [Thu Jun 16 16:25:13 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:25:13.269916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-93e88df2-dbf0-4933-9afd-963a56d84800 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38c0140790>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:13.299813 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-93e88df2-dbf0-4933-9afd-963a56d84800 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65" status: 200 len: 287 microversion: 2.1 time: 0.033696 Jun 16 16:25:13.300384 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 578/1147] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 16:25:13 2022] GET /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:25:14.312108 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8771e38a-2914-42ac-8fdc-f7c3c08c8a11 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38bb433310>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:14.342894 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8771e38a-2914-42ac-8fdc-f7c3c08c8a11 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65" status: 200 len: 287 microversion: 2.1 time: 0.035625 Jun 16 16:25:14.343460 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 570/1148] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 16:25:14 2022] GET /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:25:15.355883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7e85f9a0-0f40-4777-82eb-b264aed6b554 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38bbf80940>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:15.391026 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7e85f9a0-0f40-4777-82eb-b264aed6b554 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65" status: 200 len: 287 microversion: 2.1 time: 0.039452 Jun 16 16:25:15.391606 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 579/1149] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 16:25:15 2022] GET /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:25:16.406928 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-94ac725b-9676-420a-98d8-1b1b2e036c82 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38bb4f43a0>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:16.441149 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-94ac725b-9676-420a-98d8-1b1b2e036c82 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65" status: 200 len: 288 microversion: 2.1 time: 0.041740 Jun 16 16:25:16.441727 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 571/1150] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 16:25:16 2022] GET /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65 => generated 288 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:25:16.452471 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-940f7720-5b69-4ead-bc92-f3553514e9b7 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38bb4d4ee0>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:16.513488 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-940f7720-5b69-4ead-bc92-f3553514e9b7 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65" status: 202 len: 0 microversion: 2.1 time: 0.065266 Jun 16 16:25:16.514294 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 580/1151] 10.222.0.17 () {58 vars in 1253 bytes} [Thu Jun 16 16:25:16 2022] DELETE /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:25:16.522417 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c7b7c6ee-aa40-4798-96f1-cd61abdd2da5 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38bb433b80>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:16.556212 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c7b7c6ee-aa40-4798-96f1-cd61abdd2da5 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65" status: 200 len: 287 microversion: 2.1 time: 0.037542 Jun 16 16:25:16.556924 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 572/1152] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 16:25:16 2022] GET /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:25:17.567678 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=12 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:17.568441 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=24 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:17.573573 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fd04db18-6306-4555-9b73-01fb840ffe1b tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38c02231f0>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:17.599829 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-fd04db18-6306-4555-9b73-01fb840ffe1b tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] HTTP exception thrown: Snapshot 39e318a9-a815-45df-88b6-fe08cf233d65 could not be found. Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fd04db18-6306-4555-9b73-01fb840ffe1b tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Request method failure captured: Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65 HTTP/1.1 Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ln7hUKXWuwoJW0agZG7NRmz11AmbI9xLcYsPtZ0qzu69csUg6DjH6HmnYr1HuIXoUXjD7Nod6iqAChOzhlq36fjMjn7yZdrnd_TuhZBEAHQU9kRxMfR4X-Y-PxadhySIrQk2tkj7Av7ywDchABCLe06vXG02YkbEujQw_bwhiPjTQ Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 2aba1902188b4aeea6f353c25692a234 Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-408395601 Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:25:17.602052 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:25:17.603657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2aba1902188b4aeea6f353c25692a234"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2aba1902188b4aeea6f353c25692a234"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2aba1902188b4aeea6f353c25692a234"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2aba1902188b4aeea6f353c25692a234"}]}] Jun 16 16:25:17.603657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-VolumesSnapshotsTestJSON-408395601 Jun 16 16:25:17.603657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 2aba1902188b4aeea6f353c25692a234 Jun 16 16:25:17.603657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-408395601 Jun 16 16:25:17.603657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-VolumesSnapshotsTestJSON-408395601-project Jun 16 16:25:17.603657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:25:17.603657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:25:17.603657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 34b79c4877c948bfb09be2fefb4d71e9 Jun 16 16:25:17.603657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-VolumesSnapshotsTestJSON-408395601-project Jun 16 16:25:17.603657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: Jun 16 16:25:17.603657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Snapshot 39e318a9-a815-45df-88b6-fe08cf233d65 could not be found. Jun 16 16:25:17.603657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': '39e318a9-a815-45df-88b6-fe08cf233d65'} Jun 16 16:25:17.603657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 39e318a9-a815-45df-88b6-fe08cf233d65 could not be found. (HTTP 404) (Request-ID: req-7ca6031c-55a4-48c0-a5f0-3b321144a328) Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:17.604668 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:25:17.606154 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 39e318a9-a815-45df-88b6-fe08cf233d65 could not be found. Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 16:25:17.608387 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:25:17.610038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 39e318a9-a815-45df-88b6-fe08cf233d65 could not be found. Jun 16 16:25:17.610038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:17.610038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:17.610038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:17.610038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:17.610038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:17.610038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:17.610038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:25:17.610038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:25:17.610038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 39e318a9-a815-45df-88b6-fe08cf233d65 could not be found. Jun 16 16:25:17.610038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:17.610038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-fd04db18-6306-4555-9b73-01fb840ffe1b tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Returning 404 to user: Snapshot 39e318a9-a815-45df-88b6-fe08cf233d65 could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:25:17.610038 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-fd04db18-6306-4555-9b73-01fb840ffe1b tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65" status: 404 len: 111 microversion: 2.1 time: 0.036552 Jun 16 16:25:17.612284 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 581/1153] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 16:25:17 2022] GET /compute/v2.1/os-snapshots/39e318a9-a815-45df-88b6-fe08cf233d65 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:25:17.612446 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:17.612446 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:17.615208 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-81dbea5d-7481-4acf-bb4b-f6dc75e0bd97 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38bb748af0>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:17.682587 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-81dbea5d-7481-4acf-bb4b-f6dc75e0bd97 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21" status: 202 len: 0 microversion: 2.1 time: 0.073613 Jun 16 16:25:17.683215 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 573/1154] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 16:25:17 2022] DELETE /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:25:17.692470 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-41368f43-a01c-45c3-b64d-f427330122b1 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38bbf82550>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:17.749283 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-41368f43-a01c-45c3-b64d-f427330122b1 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21" status: 200 len: 344 microversion: 2.1 time: 0.060667 Jun 16 16:25:17.749848 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 582/1155] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:25:17 2022] GET /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:25:18.763918 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-852df222-1603-42fa-b87a-04bfe3788ecf tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38bb4f4040>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:18.796069 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-852df222-1603-42fa-b87a-04bfe3788ecf tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] HTTP exception thrown: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-852df222-1603-42fa-b87a-04bfe3788ecf tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Request method failure captured: Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21 HTTP/1.1 Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ln7hUKXWuwoJW0agZG7NRmz11AmbI9xLcYsPtZ0qzu69csUg6DjH6HmnYr1HuIXoUXjD7Nod6iqAChOzhlq36fjMjn7yZdrnd_TuhZBEAHQU9kRxMfR4X-Y-PxadhySIrQk2tkj7Av7ywDchABCLe06vXG02YkbEujQw_bwhiPjTQ Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 2aba1902188b4aeea6f353c25692a234 Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-408395601 Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:25:18.798118 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:25:18.800581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2aba1902188b4aeea6f353c25692a234"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2aba1902188b4aeea6f353c25692a234"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2aba1902188b4aeea6f353c25692a234"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2aba1902188b4aeea6f353c25692a234"}]}] Jun 16 16:25:18.800581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-VolumesSnapshotsTestJSON-408395601 Jun 16 16:25:18.800581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 2aba1902188b4aeea6f353c25692a234 Jun 16 16:25:18.800581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-408395601 Jun 16 16:25:18.800581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-VolumesSnapshotsTestJSON-408395601-project Jun 16 16:25:18.800581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:25:18.800581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:25:18.800581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 34b79c4877c948bfb09be2fefb4d71e9 Jun 16 16:25:18.800581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-VolumesSnapshotsTestJSON-408395601-project Jun 16 16:25:18.800581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: Jun 16 16:25:18.800581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. Jun 16 16:25:18.800581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': 'da5444c5-8678-4f79-a30c-b315dc195f21'} Jun 16 16:25:18.800581 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. (HTTP 404) (Request-ID: req-a6602e09-81cd-4b79-ad38-3b8a9d5b2fb1) Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:18.802170 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:25:18.804685 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 16:25:18.807016 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:25:18.809026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. Jun 16 16:25:18.809026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.809026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:18.809026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.809026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:18.809026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:18.809026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:18.809026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:25:18.809026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:25:18.809026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. Jun 16 16:25:18.809026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.809026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-852df222-1603-42fa-b87a-04bfe3788ecf tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Returning 404 to user: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:25:18.809026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-852df222-1603-42fa-b87a-04bfe3788ecf tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21" status: 404 len: 109 microversion: 2.1 time: 0.040999 Jun 16 16:25:18.809026 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 574/1156] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:25:18 2022] GET /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:25:18.815793 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b5160fbb-98e9-44e1-b1c6-d2efa1dec3aa tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38c0140670>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:18.844658 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-b5160fbb-98e9-44e1-b1c6-d2efa1dec3aa tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] HTTP exception thrown: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b5160fbb-98e9-44e1-b1c6-d2efa1dec3aa tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Request method failure captured: Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: DELETE /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21 HTTP/1.1 Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1ln7hUKXWuwoJW0agZG7NRmz11AmbI9xLcYsPtZ0qzu69csUg6DjH6HmnYr1HuIXoUXjD7Nod6iqAChOzhlq36fjMjn7yZdrnd_TuhZBEAHQU9kRxMfR4X-Y-PxadhySIrQk2tkj7Av7ywDchABCLe06vXG02YkbEujQw_bwhiPjTQ Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: 2aba1902188b4aeea6f353c25692a234 Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-408395601 Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:25:18.846660 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:25:18.848419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2aba1902188b4aeea6f353c25692a234"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2aba1902188b4aeea6f353c25692a234"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2aba1902188b4aeea6f353c25692a234"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2aba1902188b4aeea6f353c25692a234"}]}] Jun 16 16:25:18.848419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-VolumesSnapshotsTestJSON-408395601 Jun 16 16:25:18.848419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: 2aba1902188b4aeea6f353c25692a234 Jun 16 16:25:18.848419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-408395601 Jun 16 16:25:18.848419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-VolumesSnapshotsTestJSON-408395601-project Jun 16 16:25:18.848419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:25:18.848419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:25:18.848419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 34b79c4877c948bfb09be2fefb4d71e9 Jun 16 16:25:18.848419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-VolumesSnapshotsTestJSON-408395601-project Jun 16 16:25:18.848419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: Jun 16 16:25:18.848419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. Jun 16 16:25:18.848419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': 'da5444c5-8678-4f79-a30c-b315dc195f21'} Jun 16 16:25:18.848419 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. (HTTP 404) (Request-ID: req-a5b19b1c-3453-481a-9126-5ccd51645f6a) Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:18.849430 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:25:18.851044 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 16:25:18.852617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:25:18.854235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. Jun 16 16:25:18.854235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.854235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:18.854235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.854235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:18.854235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:18.854235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:18.854235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:25:18.854235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:25:18.854235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. Jun 16 16:25:18.854235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.854235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-b5160fbb-98e9-44e1-b1c6-d2efa1dec3aa tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Returning 404 to user: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:25:18.854235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-b5160fbb-98e9-44e1-b1c6-d2efa1dec3aa tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21" status: 404 len: 109 microversion: 2.1 time: 0.036654 Jun 16 16:25:18.854235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 583/1157] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 16:25:18 2022] DELETE /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:25:18.856892 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c228ade0-f8d7-4c05-95ed-f1072a42e548 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Calling method '.version_select at 0x7f38c0205b80>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:18.884992 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-c228ade0-f8d7-4c05-95ed-f1072a42e548 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] HTTP exception thrown: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c228ade0-f8d7-4c05-95ed-f1072a42e548 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Request method failure captured: Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21 HTTP/1.1 Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1ln7hUKXWuwoJW0agZG7NRmz11AmbI9xLcYsPtZ0qzu69csUg6DjH6HmnYr1HuIXoUXjD7Nod6iqAChOzhlq36fjMjn7yZdrnd_TuhZBEAHQU9kRxMfR4X-Y-PxadhySIrQk2tkj7Av7ywDchABCLe06vXG02YkbEujQw_bwhiPjTQ Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: 2aba1902188b4aeea6f353c25692a234 Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-408395601 Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:25:18.886995 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:25:18.889107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2aba1902188b4aeea6f353c25692a234"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2aba1902188b4aeea6f353c25692a234"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2aba1902188b4aeea6f353c25692a234"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2aba1902188b4aeea6f353c25692a234"}]}] Jun 16 16:25:18.889107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-VolumesSnapshotsTestJSON-408395601 Jun 16 16:25:18.889107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: 2aba1902188b4aeea6f353c25692a234 Jun 16 16:25:18.889107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-408395601 Jun 16 16:25:18.889107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-VolumesSnapshotsTestJSON-408395601-project Jun 16 16:25:18.889107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:25:18.889107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:25:18.889107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 34b79c4877c948bfb09be2fefb4d71e9 Jun 16 16:25:18.889107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-VolumesSnapshotsTestJSON-408395601-project Jun 16 16:25:18.889107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: Jun 16 16:25:18.889107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. Jun 16 16:25:18.889107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': 'da5444c5-8678-4f79-a30c-b315dc195f21'} Jun 16 16:25:18.889107 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. (HTTP 404) (Request-ID: req-cd96bbfd-c1a7-4f6c-9a0c-412ff6efe903) Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:18.890293 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:25:18.892143 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 16:25:18.893355 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:25:18.895046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. Jun 16 16:25:18.895046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.895046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:18.895046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.895046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:18.895046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:18.895046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:18.895046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:25:18.895046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:25:18.895046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. Jun 16 16:25:18.895046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:25:18.895046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-c228ade0-f8d7-4c05-95ed-f1072a42e548 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] Returning 404 to user: Volume da5444c5-8678-4f79-a30c-b315dc195f21 could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:25:18.895046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-c228ade0-f8d7-4c05-95ed-f1072a42e548 tempest-VolumesSnapshotsTestJSON-408395601 tempest-VolumesSnapshotsTestJSON-408395601-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21" status: 404 len: 109 microversion: 2.1 time: 0.035447 Jun 16 16:25:18.895046 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 575/1158] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 16:25:18 2022] GET /compute/v2.1/os-volumes/da5444c5-8678-4f79-a30c-b315dc195f21 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:25:59.024322 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-7c093e5a-7538-44d3-a498-ab1313263182 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:59.031747 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-f4b0c35b-3990-4de0-b3c8-29a51b6551f6 req-4c35d51d-b8c8-4139-9a0d-6e68b61f85b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3edfd3e1-fd3e-4455-a860-d55a2f67ef3d", "tag": "d9220eec-1f6d-431f-9e5e-4374035faf5f"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:25:59.032311 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7c093e5a-7538-44d3-a498-ab1313263182 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:59.039022 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7c093e5a-7538-44d3-a498-ab1313263182 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:59.039370 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7c093e5a-7538-44d3-a498-ab1313263182 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:59.040077 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-f4b0c35b-3990-4de0-b3c8-29a51b6551f6 req-4c35d51d-b8c8-4139-9a0d-6e68b61f85b2 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:59.040235 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7c093e5a-7538-44d3-a498-ab1313263182 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:59.040558 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-7c093e5a-7538-44d3-a498-ab1313263182 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:59.040823 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-f4b0c35b-3990-4de0-b3c8-29a51b6551f6 req-4c35d51d-b8c8-4139-9a0d-6e68b61f85b2 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:59.052374 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-f4b0c35b-3990-4de0-b3c8-29a51b6551f6 req-4c35d51d-b8c8-4139-9a0d-6e68b61f85b2 service nova] Creating event network-changed:d9220eec-1f6d-431f-9e5e-4374035faf5f for instance 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d on hv-cinder-83716 Jun 16 16:25:59.057731 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-f4b0c35b-3990-4de0-b3c8-29a51b6551f6 req-4c35d51d-b8c8-4139-9a0d-6e68b61f85b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031572 Jun 16 16:25:59.058372 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 576/1159] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:25:59.069397 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-7c093e5a-7538-44d3-a498-ab1313263182 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Going to try to terminate instance {{(pid=117756) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:25:59.163174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-7c093e5a-7538-44d3-a498-ab1313263182 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 204 len: 0 microversion: 2.1 time: 0.144009 Jun 16 16:25:59.176712 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-92d4f7f7-dcbe-4d68-9925-f02aaf6393f8 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:59.178637 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-92d4f7f7-dcbe-4d68-9925-f02aaf6393f8 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:59.178895 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 584/1160] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:25:59 2022] DELETE /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:25:59.185012 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92d4f7f7-dcbe-4d68-9925-f02aaf6393f8 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:59.185563 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92d4f7f7-dcbe-4d68-9925-f02aaf6393f8 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:59.186477 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92d4f7f7-dcbe-4d68-9925-f02aaf6393f8 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:59.187090 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-92d4f7f7-dcbe-4d68-9925-f02aaf6393f8 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:59.357714 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-92d4f7f7-dcbe-4d68-9925-f02aaf6393f8 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:59.368916 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-92d4f7f7-dcbe-4d68-9925-f02aaf6393f8 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.199037 Jun 16 16:25:59.370022 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 577/1161] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:59 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:00.389173 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-cc28e59a-8dc3-401d-badd-677996b24def tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:00.390090 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-cc28e59a-8dc3-401d-badd-677996b24def tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:00.398302 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cc28e59a-8dc3-401d-badd-677996b24def tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:00.398932 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cc28e59a-8dc3-401d-badd-677996b24def tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:00.399736 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cc28e59a-8dc3-401d-badd-677996b24def tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:00.400170 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-cc28e59a-8dc3-401d-badd-677996b24def tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:00.638883 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-cc28e59a-8dc3-401d-badd-677996b24def tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:00.648487 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-cc28e59a-8dc3-401d-badd-677996b24def tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1568 microversion: 2.1 time: 0.263189 Jun 16 16:26:00.649629 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 585/1162] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:00 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:01.484278 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-ca254d44-b3c3-4c15-957a-f9112900ce6f req-ee1a51bb-c8d7-4d4c-a7a6-649acd0b793d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3edfd3e1-fd3e-4455-a860-d55a2f67ef3d", "name": "network-vif-deleted", "tag": "d9220eec-1f6d-431f-9e5e-4374035faf5f"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:26:01.494417 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-ca254d44-b3c3-4c15-957a-f9112900ce6f req-ee1a51bb-c8d7-4d4c-a7a6-649acd0b793d service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:01.494862 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-ca254d44-b3c3-4c15-957a-f9112900ce6f req-ee1a51bb-c8d7-4d4c-a7a6-649acd0b793d service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:01.514606 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-ca254d44-b3c3-4c15-957a-f9112900ce6f req-ee1a51bb-c8d7-4d4c-a7a6-649acd0b793d service nova] Creating event network-vif-deleted:d9220eec-1f6d-431f-9e5e-4374035faf5f for instance 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d on hv-cinder-83716 Jun 16 16:26:01.521290 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-ca254d44-b3c3-4c15-957a-f9112900ce6f req-ee1a51bb-c8d7-4d4c-a7a6-649acd0b793d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040606 Jun 16 16:26:01.521885 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 578/1163] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:26:01.668745 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6972239f-b0e7-40ce-b096-1f6ce506e8cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:01.669323 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6972239f-b0e7-40ce-b096-1f6ce506e8cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:01.679768 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6972239f-b0e7-40ce-b096-1f6ce506e8cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:01.680240 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6972239f-b0e7-40ce-b096-1f6ce506e8cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:01.681034 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6972239f-b0e7-40ce-b096-1f6ce506e8cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:01.681493 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-6972239f-b0e7-40ce-b096-1f6ce506e8cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:01.747867 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6972239f-b0e7-40ce-b096-1f6ce506e8cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c7129a52e49c698cb2dc4afe14de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7ec755d96f4dee964a003d6c269c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:01.757296 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6972239f-b0e7-40ce-b096-1f6ce506e8cd tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 200 len: 1218 microversion: 2.1 time: 0.092417 Jun 16 16:26:01.757877 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 586/1164] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:01 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:02.776616 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ffac7f4f-4452-4657-955c-eceb6776ab12 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:02.777370 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ffac7f4f-4452-4657-955c-eceb6776ab12 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] [instance: 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:02.790522 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ffac7f4f-4452-4657-955c-eceb6776ab12 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:02.791297 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ffac7f4f-4452-4657-955c-eceb6776ab12 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:02.792385 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ffac7f4f-4452-4657-955c-eceb6776ab12 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:02.793063 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ffac7f4f-4452-4657-955c-eceb6776ab12 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:02.807680 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-ffac7f4f-4452-4657-955c-eceb6776ab12 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] HTTP exception thrown: Instance 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d could not be found. Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ffac7f4f-4452-4657-955c-eceb6776ab12 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Request method failure captured: Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d HTTP/1.1 Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1hnVLVSUs1Pf-d-zmWiBxhN9BbhTrExMVa0xN3HQxX1-08WmWvO86BHM54FQRfbkWd9Si_YrR6Dk0bs0KJ3DsMYxv2og4DqHkLRyZzGQusNcbW6c5QW1i-wkM_CpJ6eKF2SLZ8jnXoWNdKv-jBDABqJSMlhq8WXl75jv2IxIj1mhzM Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: bd7ec755d96f4dee964a003d6c269c4e Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-TestShelveInstance-788528323 Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:26:02.809323 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:26:02.811067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bd7ec755d96f4dee964a003d6c269c4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bd7ec755d96f4dee964a003d6c269c4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bd7ec755d96f4dee964a003d6c269c4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bd7ec755d96f4dee964a003d6c269c4e"}]}] Jun 16 16:26:02.811067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-TestShelveInstance-788528323 Jun 16 16:26:02.811067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: bd7ec755d96f4dee964a003d6c269c4e Jun 16 16:26:02.811067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-TestShelveInstance-788528323 Jun 16 16:26:02.811067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-TestShelveInstance-788528323-project Jun 16 16:26:02.811067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:26:02.811067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:26:02.811067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 080c7129a52e49c698cb2dc4afe14de7 Jun 16 16:26:02.811067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-TestShelveInstance-788528323-project Jun 16 16:26:02.811067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:26:02.811067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d could not be found. Jun 16 16:26:02.811067 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': '3edfd3e1-fd3e-4455-a860-d55a2f67ef3d'} Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d could not be found. Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:26:02.812122 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d could not be found. Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d could not be found. Jun 16 16:26:02.813725 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:26:02.815266 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ffac7f4f-4452-4657-955c-eceb6776ab12 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Returning 404 to user: Instance 3edfd3e1-fd3e-4455-a860-d55a2f67ef3d could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:26:02.815266 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ffac7f4f-4452-4657-955c-eceb6776ab12 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d" status: 404 len: 111 microversion: 2.1 time: 0.038983 Jun 16 16:26:02.815266 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 579/1165] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:02 2022] GET /compute/v2.1/servers/3edfd3e1-fd3e-4455-a860-d55a2f67ef3d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:26:02.980900 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-a7ee60b4-3edb-408b-901a-5be0930619a7 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] Calling method '.version_select at 0x7f38c028ef70>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:03.004581 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-a7ee60b4-3edb-408b-901a-5be0930619a7 tempest-TestShelveInstance-788528323 tempest-TestShelveInstance-788528323-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-229178973" status: 202 len: 0 microversion: 2.1 time: 0.027956 Jun 16 16:26:03.005281 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 587/1166] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 16:26:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-229178973 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:26:21.064696 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1401612238", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1070108778", "security_groups": [{"name": "tempest-secgroup-smoke-1016408516"}], "block_device_mapping_v2": [{"uuid": "6e1271b0-e11a-40df-a5d9-84c48033f84c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8adc531-7e83-47cd-8743-c56fb61916fb"}]}} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:26:21.073427 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=8 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:26:21.074112 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=12 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:26:21.182972 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.network.neutron [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] validate_networks() for [('c8adc531-7e83-47cd-8743-c56fb61916fb', None, None, None, None, None)] {{(pid=117755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:26:21.559617 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Flavor limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:26:21.560076 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Image limits 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:26:21.560588 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Flavor pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:26:21.561025 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Image pref 0:0:0 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:26:21.561474 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.virt.hardware [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:26:21.571537 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:21.571989 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:21.572798 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:21.573282 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:21.590545 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Getting quotas for project b77126371c5d44db8ab75fbfca0737af. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:26:21.594588 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.quota [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Getting quotas for user 373d58e9f0e6472dad412ac02bff2b94 and project b77126371c5d44db8ab75fbfca0737af. Resources: {'instances', 'cores', 'ram'} {{(pid=117755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:26:21.655004 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Going to run 1 instances... {{(pid=117755) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:26:21.657677 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e1271b0-e11a-40df-a5d9-84c48033f84c',volume_size=None,volume_type=None)] {{(pid=117755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:26:21.788506 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-0c66c301-5b17-4f91-8ccc-b3b54d1b009a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.728549 Jun 16 16:26:21.789471 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 580/1167] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 16:26:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:26:21.796769 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:26:21.798193 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:26:21.802953 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-6ba540cc-68fb-4943-b70b-86a14ce9141a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:21.803794 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-6ba540cc-68fb-4943-b70b-86a14ce9141a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:21.865026 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-6ba540cc-68fb-4943-b70b-86a14ce9141a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:21.871786 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-6ba540cc-68fb-4943-b70b-86a14ce9141a tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1095 microversion: 2.1 time: 0.076477 Jun 16 16:26:21.872360 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 588/1168] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:21 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:22.889597 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a1bc8467-8d29-4a5a-b642-6a0fc62443ab tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:22.890879 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a1bc8467-8d29-4a5a-b642-6a0fc62443ab tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:22.898926 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a1bc8467-8d29-4a5a-b642-6a0fc62443ab tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:22.899384 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a1bc8467-8d29-4a5a-b642-6a0fc62443ab tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:22.900166 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a1bc8467-8d29-4a5a-b642-6a0fc62443ab tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:22.900638 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a1bc8467-8d29-4a5a-b642-6a0fc62443ab tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:22.969459 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a1bc8467-8d29-4a5a-b642-6a0fc62443ab tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:22.978326 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a1bc8467-8d29-4a5a-b642-6a0fc62443ab tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1211 microversion: 2.1 time: 0.093062 Jun 16 16:26:22.978909 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 581/1169] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:22 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:23.996111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-44a09bc9-8893-4474-9a04-aa0a90240a96 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:23.996759 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-44a09bc9-8893-4474-9a04-aa0a90240a96 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:24.003897 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-44a09bc9-8893-4474-9a04-aa0a90240a96 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:24.004351 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-44a09bc9-8893-4474-9a04-aa0a90240a96 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:24.005139 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-44a09bc9-8893-4474-9a04-aa0a90240a96 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:24.005572 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-44a09bc9-8893-4474-9a04-aa0a90240a96 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:24.204924 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-44a09bc9-8893-4474-9a04-aa0a90240a96 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:24.213009 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-44a09bc9-8893-4474-9a04-aa0a90240a96 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1267 microversion: 2.1 time: 0.220905 Jun 16 16:26:24.213589 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 589/1170] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:23 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:24.497790 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-476454ea-c4be-49ac-a94e-ed7448176059 req-375ca29a-8e9e-41f0-a9f4-09b4df1aeea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4279c86-c1d0-4cbd-ad8d-7de767fe483b", "tag": "60ce65ed-ec30-4fc7-9bb3-9b6d549d49cd"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:26:24.518913 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-476454ea-c4be-49ac-a94e-ed7448176059 req-375ca29a-8e9e-41f0-a9f4-09b4df1aeea9 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:24.519589 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-476454ea-c4be-49ac-a94e-ed7448176059 req-375ca29a-8e9e-41f0-a9f4-09b4df1aeea9 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:24.536580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-476454ea-c4be-49ac-a94e-ed7448176059 req-375ca29a-8e9e-41f0-a9f4-09b4df1aeea9 service nova] Creating event network-changed:60ce65ed-ec30-4fc7-9bb3-9b6d549d49cd for instance f4279c86-c1d0-4cbd-ad8d-7de767fe483b on hv-cinder-83716 Jun 16 16:26:24.543805 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-476454ea-c4be-49ac-a94e-ed7448176059 req-375ca29a-8e9e-41f0-a9f4-09b4df1aeea9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049927 Jun 16 16:26:24.544710 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 582/1171] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:26:25.233427 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e6533992-6f09-416c-8d7d-61c2ead22e80 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:25.234481 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e6533992-6f09-416c-8d7d-61c2ead22e80 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:25.242441 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e6533992-6f09-416c-8d7d-61c2ead22e80 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:25.242892 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e6533992-6f09-416c-8d7d-61c2ead22e80 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:25.243758 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e6533992-6f09-416c-8d7d-61c2ead22e80 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:25.244109 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e6533992-6f09-416c-8d7d-61c2ead22e80 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:25.504449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e6533992-6f09-416c-8d7d-61c2ead22e80 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:25.512411 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e6533992-6f09-416c-8d7d-61c2ead22e80 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1267 microversion: 2.1 time: 0.284812 Jun 16 16:26:25.521820 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 590/1172] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:25 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1267 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:26.530441 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-04349091-cffa-4387-b0a8-34c0f957abe0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:26.531148 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-04349091-cffa-4387-b0a8-34c0f957abe0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:26.538804 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-04349091-cffa-4387-b0a8-34c0f957abe0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:26.539253 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-04349091-cffa-4387-b0a8-34c0f957abe0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:26.540028 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-04349091-cffa-4387-b0a8-34c0f957abe0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:26.540461 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-04349091-cffa-4387-b0a8-34c0f957abe0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:26.678574 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-04349091-cffa-4387-b0a8-34c0f957abe0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:26.686078 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-04349091-cffa-4387-b0a8-34c0f957abe0 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1267 microversion: 2.1 time: 0.160364 Jun 16 16:26:26.686762 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 583/1173] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:26 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:27.703938 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-09765656-0cd8-4bb5-b4e5-0d8b2f24ab51 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:27.704579 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-09765656-0cd8-4bb5-b4e5-0d8b2f24ab51 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:27.712087 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-09765656-0cd8-4bb5-b4e5-0d8b2f24ab51 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:27.712532 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-09765656-0cd8-4bb5-b4e5-0d8b2f24ab51 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:27.713283 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-09765656-0cd8-4bb5-b4e5-0d8b2f24ab51 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:27.713717 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-09765656-0cd8-4bb5-b4e5-0d8b2f24ab51 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:27.853483 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-09765656-0cd8-4bb5-b4e5-0d8b2f24ab51 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:27.861000 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-09765656-0cd8-4bb5-b4e5-0d8b2f24ab51 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1267 microversion: 2.1 time: 0.160976 Jun 16 16:26:27.861584 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 591/1174] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:27 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:28.878542 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-f7444ea3-d380-4259-b56a-20c8e67c4b92 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:28.879150 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-f7444ea3-d380-4259-b56a-20c8e67c4b92 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:28.885461 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7444ea3-d380-4259-b56a-20c8e67c4b92 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:28.885917 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7444ea3-d380-4259-b56a-20c8e67c4b92 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:28.886718 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7444ea3-d380-4259-b56a-20c8e67c4b92 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:28.887157 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-f7444ea3-d380-4259-b56a-20c8e67c4b92 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:29.031241 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-f7444ea3-d380-4259-b56a-20c8e67c4b92 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:29.040703 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-f7444ea3-d380-4259-b56a-20c8e67c4b92 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1267 microversion: 2.1 time: 0.166416 Jun 16 16:26:29.041204 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 584/1175] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:28 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:30.057503 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-e76d8e30-d286-4548-a44d-195654f30aa2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:30.058151 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-e76d8e30-d286-4548-a44d-195654f30aa2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:30.064618 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e76d8e30-d286-4548-a44d-195654f30aa2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:30.065771 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e76d8e30-d286-4548-a44d-195654f30aa2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:30.066629 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e76d8e30-d286-4548-a44d-195654f30aa2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:30.067063 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-e76d8e30-d286-4548-a44d-195654f30aa2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:30.202917 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-e76d8e30-d286-4548-a44d-195654f30aa2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:30.210866 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-e76d8e30-d286-4548-a44d-195654f30aa2 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1267 microversion: 2.1 time: 0.157456 Jun 16 16:26:30.211433 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 592/1176] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:30 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:31.228493 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-a741290a-e682-4c8e-8728-9f32979fe8b8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:31.229098 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-a741290a-e682-4c8e-8728-9f32979fe8b8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:31.236562 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a741290a-e682-4c8e-8728-9f32979fe8b8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:31.237015 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a741290a-e682-4c8e-8728-9f32979fe8b8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:31.237801 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a741290a-e682-4c8e-8728-9f32979fe8b8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:31.238369 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-a741290a-e682-4c8e-8728-9f32979fe8b8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:31.375493 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-a741290a-e682-4c8e-8728-9f32979fe8b8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:31.384075 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-a741290a-e682-4c8e-8728-9f32979fe8b8 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1267 microversion: 2.1 time: 0.159461 Jun 16 16:26:31.384656 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 585/1177] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:31 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:32.400906 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-8c4727f3-a01f-46f8-875d-175c434a241e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:32.401471 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-8c4727f3-a01f-46f8-875d-175c434a241e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:32.403805 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell0:SELECT=2 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:26:32.409274 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8c4727f3-a01f-46f8-875d-175c434a241e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:32.409726 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8c4727f3-a01f-46f8-875d-175c434a241e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:32.410539 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8c4727f3-a01f-46f8-875d-175c434a241e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:32.411497 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-8c4727f3-a01f-46f8-875d-175c434a241e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:32.556760 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-8c4727f3-a01f-46f8-875d-175c434a241e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:32.565238 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-8c4727f3-a01f-46f8-875d-175c434a241e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1267 microversion: 2.1 time: 0.168037 Jun 16 16:26:32.565636 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 593/1178] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:32 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:33.581646 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-720f814b-996c-4782-baed-dff29987c281 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:33.582437 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-720f814b-996c-4782-baed-dff29987c281 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:33.585193 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=2 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:26:33.585846 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell0:SELECT=6 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:26:33.592283 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-720f814b-996c-4782-baed-dff29987c281 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:33.592731 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-720f814b-996c-4782-baed-dff29987c281 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:33.593505 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-720f814b-996c-4782-baed-dff29987c281 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:33.593958 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-720f814b-996c-4782-baed-dff29987c281 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:33.755858 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-720f814b-996c-4782-baed-dff29987c281 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:33.763935 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-720f814b-996c-4782-baed-dff29987c281 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1267 microversion: 2.1 time: 0.186248 Jun 16 16:26:33.764422 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 586/1179] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:33 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:34.781212 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-568305bf-61ae-4b67-8b01-ca386f1a1f50 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:34.781875 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-568305bf-61ae-4b67-8b01-ca386f1a1f50 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:34.790964 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-568305bf-61ae-4b67-8b01-ca386f1a1f50 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:34.791559 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-568305bf-61ae-4b67-8b01-ca386f1a1f50 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:34.792341 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-568305bf-61ae-4b67-8b01-ca386f1a1f50 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:34.792773 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-568305bf-61ae-4b67-8b01-ca386f1a1f50 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:34.861463 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [req-f4a60cc1-c2dc-4a6e-918b-81ed77b2608d req-36cc0e92-b932-4d08-9487-83e897a51b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4279c86-c1d0-4cbd-ad8d-7de767fe483b", "name": "network-vif-plugged", "status": "completed", "tag": "60ce65ed-ec30-4fc7-9bb3-9b6d549d49cd"}]} {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:26:34.870659 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-f4a60cc1-c2dc-4a6e-918b-81ed77b2608d req-36cc0e92-b932-4d08-9487-83e897a51b21 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:34.871417 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [req-f4a60cc1-c2dc-4a6e-918b-81ed77b2608d req-36cc0e92-b932-4d08-9487-83e897a51b21 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:34.887718 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.compute.server_external_events [req-f4a60cc1-c2dc-4a6e-918b-81ed77b2608d req-36cc0e92-b932-4d08-9487-83e897a51b21 service nova] Creating event network-vif-plugged:60ce65ed-ec30-4fc7-9bb3-9b6d549d49cd for instance f4279c86-c1d0-4cbd-ad8d-7de767fe483b on hv-cinder-83716 Jun 16 16:26:34.896753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [req-f4a60cc1-c2dc-4a6e-918b-81ed77b2608d req-36cc0e92-b932-4d08-9487-83e897a51b21 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039394 Jun 16 16:26:34.898010 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 587/1180] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:26:34.959640 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-568305bf-61ae-4b67-8b01-ca386f1a1f50 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:34.968447 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-568305bf-61ae-4b67-8b01-ca386f1a1f50 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1267 microversion: 2.1 time: 0.190807 Jun 16 16:26:34.968769 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 594/1181] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:34 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:35.988413 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-6ff62c3a-1971-4e23-a7d0-62caff11fb90 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:35.989256 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-6ff62c3a-1971-4e23-a7d0-62caff11fb90 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:35.999314 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6ff62c3a-1971-4e23-a7d0-62caff11fb90 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:35.999780 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6ff62c3a-1971-4e23-a7d0-62caff11fb90 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:36.000607 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6ff62c3a-1971-4e23-a7d0-62caff11fb90 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:36.001053 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-6ff62c3a-1971-4e23-a7d0-62caff11fb90 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:36.156649 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-6ff62c3a-1971-4e23-a7d0-62caff11fb90 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:36.169031 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-6ff62c3a-1971-4e23-a7d0-62caff11fb90 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1267 microversion: 2.1 time: 0.185301 Jun 16 16:26:36.169917 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 588/1182] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:35 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:37.191020 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-2245e8f9-35ba-4b6b-af4a-684dcaf309b1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:37.191637 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-2245e8f9-35ba-4b6b-af4a-684dcaf309b1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:37.198256 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2245e8f9-35ba-4b6b-af4a-684dcaf309b1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:37.198708 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2245e8f9-35ba-4b6b-af4a-684dcaf309b1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:37.199472 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2245e8f9-35ba-4b6b-af4a-684dcaf309b1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:37.199908 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-2245e8f9-35ba-4b6b-af4a-684dcaf309b1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:37.339391 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-2245e8f9-35ba-4b6b-af4a-684dcaf309b1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:37.346989 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-2245e8f9-35ba-4b6b-af4a-684dcaf309b1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1453 microversion: 2.1 time: 0.159841 Jun 16 16:26:37.347562 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 595/1183] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:37 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:37.363171 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-8d5fb183-17de-4d9d-8997-ba84b31cc46b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:37.363784 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-8d5fb183-17de-4d9d-8997-ba84b31cc46b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:37.370437 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8d5fb183-17de-4d9d-8997-ba84b31cc46b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:37.370881 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8d5fb183-17de-4d9d-8997-ba84b31cc46b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:37.371637 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8d5fb183-17de-4d9d-8997-ba84b31cc46b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:37.372073 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-8d5fb183-17de-4d9d-8997-ba84b31cc46b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:37.511690 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-8d5fb183-17de-4d9d-8997-ba84b31cc46b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:37.519595 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-8d5fb183-17de-4d9d-8997-ba84b31cc46b tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1453 microversion: 2.1 time: 0.160262 Jun 16 16:26:37.520790 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 589/1184] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:37 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:39.467601 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-23d6c637-0676-41f8-97a6-e2aa3cec39df req-21228267-cb54-4c10-8cfa-45e2c49bdf17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4279c86-c1d0-4cbd-ad8d-7de767fe483b", "tag": "60ce65ed-ec30-4fc7-9bb3-9b6d549d49cd"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:26:39.478730 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-23d6c637-0676-41f8-97a6-e2aa3cec39df req-21228267-cb54-4c10-8cfa-45e2c49bdf17 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:39.479185 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-23d6c637-0676-41f8-97a6-e2aa3cec39df req-21228267-cb54-4c10-8cfa-45e2c49bdf17 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:39.490754 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-23d6c637-0676-41f8-97a6-e2aa3cec39df req-21228267-cb54-4c10-8cfa-45e2c49bdf17 service nova] Creating event network-changed:60ce65ed-ec30-4fc7-9bb3-9b6d549d49cd for instance f4279c86-c1d0-4cbd-ad8d-7de767fe483b on hv-cinder-83716 Jun 16 16:26:39.495954 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-23d6c637-0676-41f8-97a6-e2aa3cec39df req-21228267-cb54-4c10-8cfa-45e2c49bdf17 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032052 Jun 16 16:26:39.504806 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 596/1185] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:27:04.930511 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:27:04.931229 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Thu Jun 16 16:27:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:27:09.806075 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:27:09.806684 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Thu Jun 16 16:27:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:28:19.383961 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:28:19.384720 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG dbcounter [-] [117755] Writing DB stats nova_cell1:SELECT=48 {{(pid=117755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:28:19.387796 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_api:SELECT=20 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:28:19.388880 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG dbcounter [-] [117756] Writing DB stats nova_cell1:SELECT=44 {{(pid=117756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:28:19.389023 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-9f83fd18-3ee5-4381-9399-de760f72c06e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:28:19.389412 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9f83fd18-3ee5-4381-9399-de760f72c06e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:28:19.396981 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-0e6361c9-7536-4d87-bb4e-835ed34420b4 req-9a21e858-e0c2-4298-9d5a-7c546f707634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4279c86-c1d0-4cbd-ad8d-7de767fe483b", "tag": "60ce65ed-ec30-4fc7-9bb3-9b6d549d49cd"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:28:19.397409 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9f83fd18-3ee5-4381-9399-de760f72c06e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:19.397866 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9f83fd18-3ee5-4381-9399-de760f72c06e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:19.398827 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9f83fd18-3ee5-4381-9399-de760f72c06e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:19.399466 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-9f83fd18-3ee5-4381-9399-de760f72c06e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:19.407658 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-0e6361c9-7536-4d87-bb4e-835ed34420b4 req-9a21e858-e0c2-4298-9d5a-7c546f707634 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:19.408195 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-0e6361c9-7536-4d87-bb4e-835ed34420b4 req-9a21e858-e0c2-4298-9d5a-7c546f707634 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:19.420507 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-0e6361c9-7536-4d87-bb4e-835ed34420b4 req-9a21e858-e0c2-4298-9d5a-7c546f707634 service nova] Creating event network-changed:60ce65ed-ec30-4fc7-9bb3-9b6d549d49cd for instance f4279c86-c1d0-4cbd-ad8d-7de767fe483b on hv-cinder-83716 Jun 16 16:28:19.425784 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-0e6361c9-7536-4d87-bb4e-835ed34420b4 req-9a21e858-e0c2-4298-9d5a-7c546f707634 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041214 Jun 16 16:28:19.427010 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 597/1186] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:28:19.429356 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-9f83fd18-3ee5-4381-9399-de760f72c06e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:28:19.526580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-9f83fd18-3ee5-4381-9399-de760f72c06e tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 204 len: 0 microversion: 2.1 time: 0.144445 Jun 16 16:28:19.527259 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 590/1187] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:28:19 2022] DELETE /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:28:19.545584 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-26ac2fc9-a137-4bd3-805a-5f37560ef7f1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:28:19.548244 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-26ac2fc9-a137-4bd3-805a-5f37560ef7f1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:28:19.560617 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-26ac2fc9-a137-4bd3-805a-5f37560ef7f1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:19.561111 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-26ac2fc9-a137-4bd3-805a-5f37560ef7f1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:19.562190 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-26ac2fc9-a137-4bd3-805a-5f37560ef7f1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:19.562764 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-26ac2fc9-a137-4bd3-805a-5f37560ef7f1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:19.899603 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-26ac2fc9-a137-4bd3-805a-5f37560ef7f1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:28:19.907471 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-26ac2fc9-a137-4bd3-805a-5f37560ef7f1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1577 microversion: 2.1 time: 0.372968 Jun 16 16:28:19.908045 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 598/1188] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:28:19 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1577 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:28:20.928531 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-d4af72c6-5b37-4eab-a32d-d50f2bc94846 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:28:20.929249 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-d4af72c6-5b37-4eab-a32d-d50f2bc94846 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:28:20.936522 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4af72c6-5b37-4eab-a32d-d50f2bc94846 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:20.936983 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4af72c6-5b37-4eab-a32d-d50f2bc94846 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:20.937763 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4af72c6-5b37-4eab-a32d-d50f2bc94846 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:20.938234 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-d4af72c6-5b37-4eab-a32d-d50f2bc94846 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:21.154259 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-d4af72c6-5b37-4eab-a32d-d50f2bc94846 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:28:21.163670 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-d4af72c6-5b37-4eab-a32d-d50f2bc94846 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1577 microversion: 2.1 time: 0.240243 Jun 16 16:28:21.164239 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 591/1189] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:28:20 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1577 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:28:21.837167 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-0ba07daf-1de1-4d7f-95ea-01788edba82e req-bb206a78-ce6c-4453-9db7-5083f70f8f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4279c86-c1d0-4cbd-ad8d-7de767fe483b", "name": "network-vif-deleted", "tag": "60ce65ed-ec30-4fc7-9bb3-9b6d549d49cd"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:28:21.849014 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-0ba07daf-1de1-4d7f-95ea-01788edba82e req-bb206a78-ce6c-4453-9db7-5083f70f8f94 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:21.849492 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-0ba07daf-1de1-4d7f-95ea-01788edba82e req-bb206a78-ce6c-4453-9db7-5083f70f8f94 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:21.861361 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-0ba07daf-1de1-4d7f-95ea-01788edba82e req-bb206a78-ce6c-4453-9db7-5083f70f8f94 service nova] Creating event network-vif-deleted:60ce65ed-ec30-4fc7-9bb3-9b6d549d49cd for instance f4279c86-c1d0-4cbd-ad8d-7de767fe483b on hv-cinder-83716 Jun 16 16:28:21.868384 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-0ba07daf-1de1-4d7f-95ea-01788edba82e req-bb206a78-ce6c-4453-9db7-5083f70f8f94 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035486 Jun 16 16:28:21.869175 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 599/1190] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:28:22.181014 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-919761f1-cddf-4276-acfb-64ef2b45b272 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:28:22.182601 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-919761f1-cddf-4276-acfb-64ef2b45b272 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:28:22.190468 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-919761f1-cddf-4276-acfb-64ef2b45b272 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:22.190923 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-919761f1-cddf-4276-acfb-64ef2b45b272 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:22.192686 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-919761f1-cddf-4276-acfb-64ef2b45b272 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:22.193443 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-919761f1-cddf-4276-acfb-64ef2b45b272 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:22.229198 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-919761f1-cddf-4276-acfb-64ef2b45b272 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:22.230146 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-919761f1-cddf-4276-acfb-64ef2b45b272 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:22.230675 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-919761f1-cddf-4276-acfb-64ef2b45b272 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lazy-loading 'fault' on Instance uuid f4279c86-c1d0-4cbd-ad8d-7de767fe483b {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:28:22.277510 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-919761f1-cddf-4276-acfb-64ef2b45b272 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:28:22.289816 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-919761f1-cddf-4276-acfb-64ef2b45b272 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 200 len: 1231 microversion: 2.1 time: 0.112749 Jun 16 16:28:22.290428 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 592/1191] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:28:22 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 1231 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:28:23.309348 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f4eeb837-eaab-447f-9049-b3d0b93bdff3 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:28:23.310084 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-f4eeb837-eaab-447f-9049-b3d0b93bdff3 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: f4279c86-c1d0-4cbd-ad8d-7de767fe483b] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:28:23.316781 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f4eeb837-eaab-447f-9049-b3d0b93bdff3 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:23.317236 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f4eeb837-eaab-447f-9049-b3d0b93bdff3 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:23.318036 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f4eeb837-eaab-447f-9049-b3d0b93bdff3 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:23.318478 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-f4eeb837-eaab-447f-9049-b3d0b93bdff3 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:23.334296 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-f4eeb837-eaab-447f-9049-b3d0b93bdff3 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] HTTP exception thrown: Instance f4279c86-c1d0-4cbd-ad8d-7de767fe483b could not be found. Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f4eeb837-eaab-447f-9049-b3d0b93bdff3 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Request method failure captured: Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b HTTP/1.1 Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1h1oYF_vlA3--mpP6tdYxPGW1XWRwY5NXO9weCY8DVGK7_SCgheaI8GmZLfhKQMSzIztWgvJXd9HZiUYLHL-bS3MS4yaOK38jY44Dhh4M-30UuQKXJsvcB9sY1YUReou2wx_WOeQ45tGoCTuG-xOMhm6WAySBtjZGHUzYslkiLg0ak Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: b77126371c5d44db8ab75fbfca0737af Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-TestVolumeBootPattern-1734897560 Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:28:23.335916 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:28:23.337742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b77126371c5d44db8ab75fbfca0737af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b77126371c5d44db8ab75fbfca0737af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b77126371c5d44db8ab75fbfca0737af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b77126371c5d44db8ab75fbfca0737af"}]}] Jun 16 16:28:23.337742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-TestVolumeBootPattern-1734897560 Jun 16 16:28:23.337742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: b77126371c5d44db8ab75fbfca0737af Jun 16 16:28:23.337742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-TestVolumeBootPattern-1734897560 Jun 16 16:28:23.337742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-TestVolumeBootPattern-1734897560-project Jun 16 16:28:23.337742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:28:23.337742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:28:23.337742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 373d58e9f0e6472dad412ac02bff2b94 Jun 16 16:28:23.337742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-TestVolumeBootPattern-1734897560-project Jun 16 16:28:23.337742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:28:23.337742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance f4279c86-c1d0-4cbd-ad8d-7de767fe483b could not be found. Jun 16 16:28:23.337742 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': 'f4279c86-c1d0-4cbd-ad8d-7de767fe483b'} Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4279c86-c1d0-4cbd-ad8d-7de767fe483b could not be found. Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:28:23.338739 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4279c86-c1d0-4cbd-ad8d-7de767fe483b could not be found. Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4279c86-c1d0-4cbd-ad8d-7de767fe483b could not be found. Jun 16 16:28:23.340214 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:28:23.341582 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-f4eeb837-eaab-447f-9049-b3d0b93bdff3 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Returning 404 to user: Instance f4279c86-c1d0-4cbd-ad8d-7de767fe483b could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:28:23.341582 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-f4eeb837-eaab-447f-9049-b3d0b93bdff3 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b" status: 404 len: 111 microversion: 2.1 time: 0.032259 Jun 16 16:28:23.341582 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 600/1192] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:28:23 2022] GET /compute/v2.1/servers/f4279c86-c1d0-4cbd-ad8d-7de767fe483b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:28:26.671769 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-ea77224c-d613-40e9-abf7-5b0f693d7e30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:28:26.672307 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ea77224c-d613-40e9-abf7-5b0f693d7e30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:28:26.673065 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-4e8c8f10-2e62-4570-a698-6403d6f98380 req-0d3838cd-23e4-4cb4-b762-0088998accf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73883b1-66a1-4b97-9bb8-9b1cd503adc4", "tag": "64308097-cfca-4e56-bded-c92e6aef946a"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:28:26.680623 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ea77224c-d613-40e9-abf7-5b0f693d7e30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:26.681083 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ea77224c-d613-40e9-abf7-5b0f693d7e30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:26.681868 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ea77224c-d613-40e9-abf7-5b0f693d7e30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:26.682344 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-ea77224c-d613-40e9-abf7-5b0f693d7e30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:26.682594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-4e8c8f10-2e62-4570-a698-6403d6f98380 req-0d3838cd-23e4-4cb4-b762-0088998accf4 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:26.683049 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-4e8c8f10-2e62-4570-a698-6403d6f98380 req-0d3838cd-23e4-4cb4-b762-0088998accf4 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:26.697659 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-4e8c8f10-2e62-4570-a698-6403d6f98380 req-0d3838cd-23e4-4cb4-b762-0088998accf4 service nova] Creating event network-changed:64308097-cfca-4e56-bded-c92e6aef946a for instance d73883b1-66a1-4b97-9bb8-9b1cd503adc4 on hv-cinder-83716 Jun 16 16:28:26.703592 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-4e8c8f10-2e62-4570-a698-6403d6f98380 req-0d3838cd-23e4-4cb4-b762-0088998accf4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034002 Jun 16 16:28:26.705150 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 601/1193] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:28:26.712877 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-ea77224c-d613-40e9-abf7-5b0f693d7e30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Going to try to terminate instance {{(pid=117755) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:28:26.809707 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-ea77224c-d613-40e9-abf7-5b0f693d7e30 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 204 len: 0 microversion: 2.1 time: 0.140850 Jun 16 16:28:26.811245 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 593/1194] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:28:26 2022] DELETE /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:28:26.821210 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-9bfcc1a8-dbc2-4166-beab-7cac362bec63 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:28:26.821947 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-9bfcc1a8-dbc2-4166-beab-7cac362bec63 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:28:26.829814 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9bfcc1a8-dbc2-4166-beab-7cac362bec63 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:26.830104 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9bfcc1a8-dbc2-4166-beab-7cac362bec63 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:26.831356 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9bfcc1a8-dbc2-4166-beab-7cac362bec63 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:26.831356 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-9bfcc1a8-dbc2-4166-beab-7cac362bec63 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:27.007298 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.policy [None req-9bfcc1a8-dbc2-4166-beab-7cac362bec63 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117756) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:28:27.015429 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-9bfcc1a8-dbc2-4166-beab-7cac362bec63 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1578 microversion: 2.1 time: 0.199432 Jun 16 16:28:27.016011 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 602/1195] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:28:26 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1578 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:28:28.039111 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-763fee35-70d8-4c83-aad4-0d8598f90255 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:28:28.040254 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-763fee35-70d8-4c83-aad4-0d8598f90255 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:28:28.051732 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-763fee35-70d8-4c83-aad4-0d8598f90255 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:28.052464 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-763fee35-70d8-4c83-aad4-0d8598f90255 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:28.053736 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-763fee35-70d8-4c83-aad4-0d8598f90255 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:28.054468 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-763fee35-70d8-4c83-aad4-0d8598f90255 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:28.231365 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-763fee35-70d8-4c83-aad4-0d8598f90255 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:28:28.243703 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-763fee35-70d8-4c83-aad4-0d8598f90255 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1578 microversion: 2.1 time: 0.213040 Jun 16 16:28:28.244179 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 594/1196] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:28:28 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1578 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:28:28.929860 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [req-ae6c00ad-79c7-4b09-a699-2b8b0c2a80f9 req-62cfa379-66ab-429c-a932-89298620f8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73883b1-66a1-4b97-9bb8-9b1cd503adc4", "name": "network-vif-deleted", "tag": "64308097-cfca-4e56-bded-c92e6aef946a"}]} {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:28:28.939797 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-ae6c00ad-79c7-4b09-a699-2b8b0c2a80f9 req-62cfa379-66ab-429c-a932-89298620f8b6 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:28.940211 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [req-ae6c00ad-79c7-4b09-a699-2b8b0c2a80f9 req-62cfa379-66ab-429c-a932-89298620f8b6 service nova] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:28.952550 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.compute.server_external_events [req-ae6c00ad-79c7-4b09-a699-2b8b0c2a80f9 req-62cfa379-66ab-429c-a932-89298620f8b6 service nova] Creating event network-vif-deleted:64308097-cfca-4e56-bded-c92e6aef946a for instance d73883b1-66a1-4b97-9bb8-9b1cd503adc4 on hv-cinder-83716 Jun 16 16:28:28.957629 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [req-ae6c00ad-79c7-4b09-a699-2b8b0c2a80f9 req-62cfa379-66ab-429c-a932-89298620f8b6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032682 Jun 16 16:28:28.958295 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 603/1197] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 16:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:28:29.264850 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-b81ec4dc-c69c-4ce6-94db-49ba9b013320 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:28:29.265482 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-b81ec4dc-c69c-4ce6-94db-49ba9b013320 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:28:29.272294 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b81ec4dc-c69c-4ce6-94db-49ba9b013320 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:29.273049 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b81ec4dc-c69c-4ce6-94db-49ba9b013320 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:29.273817 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b81ec4dc-c69c-4ce6-94db-49ba9b013320 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:29.274281 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b81ec4dc-c69c-4ce6-94db-49ba9b013320 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:29.311975 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b81ec4dc-c69c-4ce6-94db-49ba9b013320 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:29.312409 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-b81ec4dc-c69c-4ce6-94db-49ba9b013320 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:29.312876 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.objects.instance [None req-b81ec4dc-c69c-4ce6-94db-49ba9b013320 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lazy-loading 'fault' on Instance uuid d73883b1-66a1-4b97-9bb8-9b1cd503adc4 {{(pid=117755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:28:29.361637 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.policy [None req-b81ec4dc-c69c-4ce6-94db-49ba9b013320 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373d58e9f0e6472dad412ac02bff2b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77126371c5d44db8ab75fbfca0737af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117755) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:28:29.370091 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-b81ec4dc-c69c-4ce6-94db-49ba9b013320 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 200 len: 1231 microversion: 2.1 time: 0.109126 Jun 16 16:28:29.370682 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 595/1198] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:28:29 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 1231 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:28:30.389398 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-46c17438-6376-483e-8f5c-6c6710e2a993 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:28:30.390155 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-46c17438-6376-483e-8f5c-6c6710e2a993 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: d73883b1-66a1-4b97-9bb8-9b1cd503adc4] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:28:30.396480 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-46c17438-6376-483e-8f5c-6c6710e2a993 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:30.396931 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-46c17438-6376-483e-8f5c-6c6710e2a993 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:30.397701 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-46c17438-6376-483e-8f5c-6c6710e2a993 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:30.398174 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-46c17438-6376-483e-8f5c-6c6710e2a993 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:30.411507 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-46c17438-6376-483e-8f5c-6c6710e2a993 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] HTTP exception thrown: Instance d73883b1-66a1-4b97-9bb8-9b1cd503adc4 could not be found. Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-46c17438-6376-483e-8f5c-6c6710e2a993 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Request method failure captured: Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 HTTP/1.1 Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1h1oYF_vlA3--mpP6tdYxPGW1XWRwY5NXO9weCY8DVGK7_SCgheaI8GmZLfhKQMSzIztWgvJXd9HZiUYLHL-bS3MS4yaOK38jY44Dhh4M-30UuQKXJsvcB9sY1YUReou2wx_WOeQ45tGoCTuG-xOMhm6WAySBtjZGHUzYslkiLg0ak Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: b77126371c5d44db8ab75fbfca0737af Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-TestVolumeBootPattern-1734897560 Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:28:30.413119 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:28:30.414891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b77126371c5d44db8ab75fbfca0737af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b77126371c5d44db8ab75fbfca0737af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b77126371c5d44db8ab75fbfca0737af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b77126371c5d44db8ab75fbfca0737af"}]}] Jun 16 16:28:30.414891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-TestVolumeBootPattern-1734897560 Jun 16 16:28:30.414891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: b77126371c5d44db8ab75fbfca0737af Jun 16 16:28:30.414891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-TestVolumeBootPattern-1734897560 Jun 16 16:28:30.414891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-TestVolumeBootPattern-1734897560-project Jun 16 16:28:30.414891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:28:30.414891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:28:30.414891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 373d58e9f0e6472dad412ac02bff2b94 Jun 16 16:28:30.414891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-TestVolumeBootPattern-1734897560-project Jun 16 16:28:30.414891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:28:30.414891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance d73883b1-66a1-4b97-9bb8-9b1cd503adc4 could not be found. Jun 16 16:28:30.414891 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': 'd73883b1-66a1-4b97-9bb8-9b1cd503adc4'} Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73883b1-66a1-4b97-9bb8-9b1cd503adc4 could not be found. Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:28:30.415807 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73883b1-66a1-4b97-9bb8-9b1cd503adc4 could not be found. Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73883b1-66a1-4b97-9bb8-9b1cd503adc4 could not be found. Jun 16 16:28:30.417306 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:28:30.418594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-46c17438-6376-483e-8f5c-6c6710e2a993 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Returning 404 to user: Instance d73883b1-66a1-4b97-9bb8-9b1cd503adc4 could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:28:30.418594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-46c17438-6376-483e-8f5c-6c6710e2a993 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4" status: 404 len: 111 microversion: 2.1 time: 0.030038 Jun 16 16:28:30.418594 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 604/1199] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:28:30 2022] GET /compute/v2.1/servers/d73883b1-66a1-4b97-9bb8-9b1cd503adc4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:28:30.877541 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-23843325-1fc5-4093-95c2-6287b5754633 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:28:30.878933 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.compute.api [None req-23843325-1fc5-4093-95c2-6287b5754633 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117755) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:28:30.885565 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-23843325-1fc5-4093-95c2-6287b5754633 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:30.886057 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-23843325-1fc5-4093-95c2-6287b5754633 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:30.886866 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-23843325-1fc5-4093-95c2-6287b5754633 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:30.887311 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG oslo_concurrency.lockutils [None req-23843325-1fc5-4093-95c2-6287b5754633 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:30.902222 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.wsgi [None req-23843325-1fc5-4093-95c2-6287b5754633 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] HTTP exception thrown: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-23843325-1fc5-4093-95c2-6287b5754633 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Request method failure captured: Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: request: DELETE /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf HTTP/1.1 Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept: application/json Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Accept-Encoding: identity Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Connection: close Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Length: 0 Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Content-Type: application/json Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Host: 10.222.0.17 Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Openstack-System-Scope: None Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: User-Agent: python-urllib3/1.26.9 Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Auth-Token: gAAAAABiq1h1oYF_vlA3--mpP6tdYxPGW1XWRwY5NXO9weCY8DVGK7_SCgheaI8GmZLfhKQMSzIztWgvJXd9HZiUYLHL-bS3MS4yaOK38jY44Dhh4M-30UuQKXJsvcB9sY1YUReou2wx_WOeQ45tGoCTuG-xOMhm6WAySBtjZGHUzYslkiLg0ak Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Id: None Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Domain-Name: None Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Identity-Status: Confirmed Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Is-Admin-Project: True Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Id: default Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Domain-Name: Default Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Id: b77126371c5d44db8ab75fbfca0737af Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Project-Name: tempest-TestVolumeBootPattern-1734897560 Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Role: member,reader Jun 16 16:28:30.903886 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Roles: member,reader Jun 16 16:28:30.905580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b77126371c5d44db8ab75fbfca0737af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b77126371c5d44db8ab75fbfca0737af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b77126371c5d44db8ab75fbfca0737af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b77126371c5d44db8ab75fbfca0737af"}]}] Jun 16 16:28:30.905580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant: tempest-TestVolumeBootPattern-1734897560 Jun 16 16:28:30.905580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Id: b77126371c5d44db8ab75fbfca0737af Jun 16 16:28:30.905580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-Tenant-Name: tempest-TestVolumeBootPattern-1734897560 Jun 16 16:28:30.905580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User: tempest-TestVolumeBootPattern-1734897560-project Jun 16 16:28:30.905580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Id: default Jun 16 16:28:30.905580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Domain-Name: Default Jun 16 16:28:30.905580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Id: 373d58e9f0e6472dad412ac02bff2b94 Jun 16 16:28:30.905580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: X-User-Name: tempest-TestVolumeBootPattern-1734897560-project Jun 16 16:28:30.905580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: method: > Jun 16 16:28:30.905580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: exception: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. Jun 16 16:28:30.905580 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: action_args: {'id': 'fe449def-0ec0-4555-96d0-af4550c361cf'} Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:28:30.906753 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. Jun 16 16:28:30.908442 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: ERROR nova.api.openstack.wsgi Jun 16 16:28:30.911147 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-23843325-1fc5-4093-95c2-6287b5754633 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Returning 404 to user: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. {{(pid=117755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:28:30.911147 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-23843325-1fc5-4093-95c2-6287b5754633 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 404 len: 111 microversion: 2.1 time: 0.032178 Jun 16 16:28:30.911147 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 596/1200] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 16:28:30 2022] DELETE /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:28:30.916360 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-18b95471-cfe5-4762-a333-3e6a8d5d9b43 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '>' {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:28:30.916962 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.compute.api [None req-18b95471-cfe5-4762-a333-3e6a8d5d9b43 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] [instance: fe449def-0ec0-4555-96d0-af4550c361cf] Fetching instance by UUID {{(pid=117756) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:28:30.923037 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-18b95471-cfe5-4762-a333-3e6a8d5d9b43 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:30.923483 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-18b95471-cfe5-4762-a333-3e6a8d5d9b43 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:30.924239 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-18b95471-cfe5-4762-a333-3e6a8d5d9b43 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:28:30.924670 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG oslo_concurrency.lockutils [None req-18b95471-cfe5-4762-a333-3e6a8d5d9b43 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Lock "14b80623-283f-4ab1-8a5f-44dd7d2daf23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:28:30.938714 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.wsgi [None req-18b95471-cfe5-4762-a333-3e6a8d5d9b43 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] HTTP exception thrown: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-18b95471-cfe5-4762-a333-3e6a8d5d9b43 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Request method failure captured: Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: request: GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf HTTP/1.1 Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept: application/json Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Accept-Encoding: identity Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Connection: close Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Length: 0 Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Content-Type: application/json Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Host: 10.222.0.17 Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Openstack-System-Scope: None Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: User-Agent: python-urllib3/1.26.9 Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Auth-Token: gAAAAABiq1h1oYF_vlA3--mpP6tdYxPGW1XWRwY5NXO9weCY8DVGK7_SCgheaI8GmZLfhKQMSzIztWgvJXd9HZiUYLHL-bS3MS4yaOK38jY44Dhh4M-30UuQKXJsvcB9sY1YUReou2wx_WOeQ45tGoCTuG-xOMhm6WAySBtjZGHUzYslkiLg0ak Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Id: None Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Domain-Name: None Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Identity-Status: Confirmed Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Is-Admin-Project: True Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Id: default Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Domain-Name: Default Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Id: b77126371c5d44db8ab75fbfca0737af Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Project-Name: tempest-TestVolumeBootPattern-1734897560 Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Role: member,reader Jun 16 16:28:30.940257 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Roles: member,reader Jun 16 16:28:30.942057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b77126371c5d44db8ab75fbfca0737af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b77126371c5d44db8ab75fbfca0737af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b77126371c5d44db8ab75fbfca0737af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b77126371c5d44db8ab75fbfca0737af"}]}] Jun 16 16:28:30.942057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant: tempest-TestVolumeBootPattern-1734897560 Jun 16 16:28:30.942057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Id: b77126371c5d44db8ab75fbfca0737af Jun 16 16:28:30.942057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-Tenant-Name: tempest-TestVolumeBootPattern-1734897560 Jun 16 16:28:30.942057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User: tempest-TestVolumeBootPattern-1734897560-project Jun 16 16:28:30.942057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Id: default Jun 16 16:28:30.942057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Domain-Name: Default Jun 16 16:28:30.942057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Id: 373d58e9f0e6472dad412ac02bff2b94 Jun 16 16:28:30.942057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: X-User-Name: tempest-TestVolumeBootPattern-1734897560-project Jun 16 16:28:30.942057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: method: > Jun 16 16:28:30.942057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: exception: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. Jun 16 16:28:30.942057 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: action_args: {'id': 'fe449def-0ec0-4555-96d0-af4550c361cf'} Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: {{(pid=117756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:28:30.943016 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. Jun 16 16:28:30.944657 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: ERROR nova.api.openstack.wsgi Jun 16 16:28:30.946133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: DEBUG nova.api.openstack.wsgi [None req-18b95471-cfe5-4762-a333-3e6a8d5d9b43 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Returning 404 to user: Instance fe449def-0ec0-4555-96d0-af4550c361cf could not be found. {{(pid=117756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:28:30.946133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO nova.api.openstack.requestlog [None req-18b95471-cfe5-4762-a333-3e6a8d5d9b43 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf" status: 404 len: 111 microversion: 2.1 time: 0.029668 Jun 16 16:28:30.946133 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: [pid: 117756|app: 0|req: 605/1201] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 16:28:30 2022] GET /compute/v2.1/servers/fe449def-0ec0-4555-96d0-af4550c361cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:28:32.247417 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: DEBUG nova.api.openstack.wsgi [None req-249e0c32-78f5-4959-8501-a4027d6db8b1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] Calling method '.version_select at 0x7f38bb472820>' {{(pid=117755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:28:32.270953 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO nova.api.openstack.requestlog [None req-249e0c32-78f5-4959-8501-a4027d6db8b1 tempest-TestVolumeBootPattern-1734897560 tempest-TestVolumeBootPattern-1734897560-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1070108778" status: 202 len: 0 microversion: 2.1 time: 0.027598 Jun 16 16:28:32.271539 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: [pid: 117755|app: 0|req: 597/1202] 10.222.0.17 () {58 vars in 1262 bytes} [Thu Jun 16 16:28:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1070108778 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:30:29.815948 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:30:29.815948 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Thu Jun 16 16:30:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:31:24.450449 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:31:24.451376 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Thu Jun 16 16:31:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:31:58.676250 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:31:58.676924 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Thu Jun 16 16:31:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:33:44.941947 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:33:44.942697 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Thu Jun 16 16:33:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:33:49.824612 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:33:49.825284 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Thu Jun 16 16:33:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:34:03.000672 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:34:03.001399 dv-cinder-837167-3-iscsi devstack@n-api.service[117756]: Thu Jun 16 16:34:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:34:05.332219 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:34:05.332219 dv-cinder-837167-3-iscsi devstack@n-api.service[117755]: Thu Jun 16 16:34:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!